Site icon ProVideo Coalition

AI Tools: The List You Need Now! (Final Installment 2023)

FINAL UPDATE: December 2023  (most recent updates in RED)

Wrapping up the year’s list of AI Tools and updates this month. Be sure to look for my final article in the series AI Tools Part 5: 2023 A Year in Review to show just how far this technology has come in just 12 months! We’ll continue with only feature articles and tutorials going into 2024, that will continue the AI Tools moniker, but I won’t be able to keep up this list now the larger industry overview articles, as the technology is developing faster than we can write about it. Literally. We’re talking daily updates now, as I predicted!

So I’m going through this list tonight and updating all the latest tools that are still developing. Today. And tomorrow. Until Dec 31st.

*Original article text:
We’re just taking a moment to catch our breath a bit in all the AI fury and start compiling a list that we can use for reference by category or all the most popular and useful AI Tools, portals and apps available to create, modify, enhance or edit your projects and creative content (I’ll add in a few that might be just for fun, too.) 🙂

I’ve purposely left off several that are either scammy in their model, not relevant to our industry or just plain garbage. If you know of any you’d like to see added to the list, please comment below and inquire for me to research it further. (Or I may tell you why it’s not on the list already)

Since my first article, AI Tools Part 1 went live, there’s been a lot of development in the tools and technology, along with concerns and opinions expressed about the legality, ethics and plausibility of their usefulness in the creative content communities. *UPDATE: Be sure to also check out these in-depth articles of this emerging technology!

AI Tools Part 2: A Deeper Dive

AI Tools Part 3: The Current State of Generative AI Tools

AI Tools Part 4: The Latest for Video, Film Production, 3D, Audio and more…

AI Tools Part 5: The Year in Review

 

So why The List You Need Now?

Before proceeding with all the more detailed deep dives into the various tools, I wanted to have one central location that everyone can reference and get updates on whatever the latest versions of  tools for various uses of AI technology – specifically related to the film, video and imaging production, editing and creative content creation industries. I will try to update this list about once a week until things begin to die-down (yeah, right!), but always check the “updated” date below, as I will mark tools that also have major updates even if previously listed.

I am also only adding tools and links to the list that I personally check out and get whatever info I can pass along, and will provide more info and details in subsequent articles for various AI tool tactics, like Image Generation, Enhancements, Video & Animation tools, Text Generation/Writing tools, Audio and Music Generation/enhancement tools and more.

NOTE: There are several Apps in the Google Play and Apple App store that carry the names of some of these tools or are just a shell that uses some of the core tools that may or may not work. Proceed at your own risk and costs.

Also note that I’m always learning, researching and testing this stuff as I go. Some information provided will be incomplete or I may use incorrect terminology or explanations of certain technologies. Admittedly, I don’t really know what I’m doing yet! If you see something that needs correction, please let me know and I’ll get it fixed! This is an evolving list of resources and ultimately, we want it to be right.

Graphic source: unknown

————

The List

FINAL UPDATE: December 2023 (most recent updates in RED)

Category Menu:

AI Image Generators

AI Image & Video Enhancement Tools

AI Audio Tools

AI TTS (Text To Speech) Tools

AI Text/Scripting Tools

AI Music Generators

AI Video Generators

AI 3D Tools

AI Utilities & Productivity Tools

AI Tool Resources and Articles

————

AI Image Generators

^ main menu

Midjouney AI v5.2 with Zoom Out (outpainting), Upscaling and Vary (Region) (inpainting)
https://midjourney.com/ (Sign up page) uses Discord to access servers. Paid plan gives you more images and a private MJ bot to develop your prompts in. Currently, this is the best way to get into generating AI images online and achieving great results with minimal prompting.

COST: Free trial then $10/30/60 monthly plans for use. You can find out more about pricing plans here.

TOOLS: Online through Discord/Discord Mobile App

DALL-E 2 (Open AI)
https://labs.openai.com/ Popular and fun AI image generator. Also provides outpainting and repainting of generated images and photos.

COST: Free first month (50 credits/200 images) Then 15 credits/60 images per subsequent mo. ($15 buys additional 115 credits/460 images).

TOOLS: Online

Stable Diffusion Playground (Online)
https://stablediffusionweb.com/ A public portal for generating images on the Stable Diffusion engine in a user-friendly (and FREE) website.

(SD is available to run on many private servers and platforms if you’re into doing some coding and are wanting to explore – and we will too when we dig deeper. Get more info from the parent site at Stability.AI) See Resources below for download and installation info and instruction videos.

COST: Free

TOOLS: Online

Adobe Firefly (Online)
https://firefly.adobe.com/ It’s what you’d expect from Adobe. It will eventually be integrated into the Creative Suite of tools, to produce images, text, inpainting/outpainting, image enhancements, vector tools and templates and more. Current beta only has limited text to image generation and creative type creation. Updated Public Beta – new features like Generative Fill, Recolor and more.

COST: Free Public Beta

TOOLS: Online

BlueWillow
https://www.bluewillow.ai/ From logos, landscapes and characters to digital artwork,  just describe the image you want and our AI image generating tool will create the perfect graphic for your project. It’s all FREE.

COST: Free Beta

TOOLS: Online

Simplified
Simplified.com A complete set of AI marketing tools for graphic design, social media, copywriting and video editing/generation in one online app.

COST: Free demo/Pricing varies across the tools/terms

TOOLS: Online

Ideogram AI
https://ideogram.ai/ an image generator that delivers results in various styles and actually produces pretty good text and clean graphic illustrations

COST: Free

TOOLS: Online

NOWAI (Alpha)
https://nowai.ai/ NOWAI is a community-centered brand in a quest to close the gap between humanity and AI. Access NOWAI from your favorite platforms. Enjoying a seamless experience across all of them.

COST: Free trial (Discord)/$8mo (Basic)/$16mo (Pro)/$40mo (Elite) *Annual pricing

TOOLS: Online/Discord/

Disco Diffusion v5.7
https://colab.research.google.com/github/alembics/disco-diffusion/blob/main/Disco_Diffusion.ipynb A clip-guided diffusion model for generating detailed and abstract images written in Python. The code is free to run on your own server or colab and you can get the resources online here.

Note that DreamStudio Lite beta (below) runs on DD.

COST: Free

TOOLS: Server/Colab/3rd party tools

DreamStudio Lite (beta)
https://beta.dreamstudio.ai/ Online text to image generator portal running on Disco Diffusion model.

COST: Free (beta)

TOOLS: Online

DeepAI
https://deepai.org/ Online text to image generator, image editor and outpainter, image colorizing.

COST: Free/$5mo (Pro)

TOOLS: Online

OpenArt
https://openart.ai/ A complete range of generative AI tools, including text-image, face swap, animated GIFs, sketch to image, image blender, sticker generator, magic brush, background removal, stock image generator/modifier, image QR codes and more.

COST: Free /$12mo Starter/$24mo Hobbyist/$56mo Pro and Annual plans

TOOLS: Online

Craiyon
https://www.craiyon.com/ Basic online text to image generator and re-imager (ad based). Formerly known as DALL-E Mini.

COST: Free with ads/$5/$20mo plans

TOOLS: Online

Leonardo AI (now featuring Motion)
https://leonardo.ai/ Create production-quality visual assets for your projects with unprecedented quality, speed, and style-consistency. NEW: Motion produces stunning animated scenes from your text prompts.

COST: Free (whitelist)/$10mo Apprentice/$24mo Artisan/$48mo Maestro (annual sub pricing)

TOOLS: Online/Discord

Lexica
https://lexica.art/ AI text to image generator and search engine using Stable Diffusion. Shows results from other creators’ images as well as generates your own.

COST: Free

TOOLS: Online portal

Mage.space
https://www.mage.space/ Online text to image generator portal running on Stable Diffusion v5 model.

COST: Free/$8 Basic/$15 Pro/$30 Pro Plus

TOOLS: Online

NightCafe Studio
https://creator.nightcafe.studio/ Online text to image generator portal running on multiple diffusion models; Stable Diffusion, DALL-E 2, CLIP-Guided Diffusion, VQGAN+CLIP and Neural Style Transfer are all available on NightCafe. There is also a Discord group here in the NightCafe Lounge.

COST: Free

TOOLS: Online

ShutterStock AI
https://www.shutterstock.com/generate Online text to image generator portal from stock Image provider, ShutterStock. Seems legit and it’s free, but there are some licensing restrictions in the FAQ so please read and understand.

COST: Free

TOOLS: Online

InvokeAI 2.3.0
Watch the YouTube video first. (download installer link in description) Server-based AI text to image generator. InvokeAI now supports the brand new Diffusers Models and now has Model Merge and Textual Inversion Training.

COST: Free (public)

TOOLS: Server/Colab

Stability AI Photoshop Plugin
https://christiancantrell.com/#ai-ml The Stability Photoshop plugin allows you to generate and edit images using both Stable Diffusion and DALL•E 2 right inside Photoshop.

COST: Free

TOOLS: Photoshop Plugin (Adobe Exchange)

Blockade Labs Skybox Lab (with new sketch to image tools)
https://www.blockadelabs.com/ Skybox Lab – text to 360 panorama generator – the ultimate AI-powered solution for generating incredible 360° skybox experiences from text prompts. (Also see the Nadir Patch tool to make your 360 pano work in social media and online.)

COST: Free

TOOLS: Online portal

Bing Image Creator
Announcing the next wave of AI innovation with Microsoft Bing and Edge – The Official Microsoft Blog – We recently announced the integration of Bing Image Creator into the new Bing chat experience making Bing the only search experience with the ability to generate both written and visual content in one place, from within chat. And today, I’m excited to share that we are expanding Image Creator to all languages in Bing – that’s more than 100 languages – so now you can create images in your native language.

COST: Free

TOOLS: Online (Microsoft Edge)

Krea (beta)
https://www.krea.ai/home Amazing real-time text/shape/color to image generator plus image enhancement.

COST: Free (beta)

TOOLS: Online

Playground
https://playgroundai.com/ Pre-generated galleries from various contributing artists with their prompts/negative prompts. Allows you to copy the prompts or regenerate the images to your own liking.

COST: Free

TOOLS: Online

Artbreeder
https://www.artbreeder.com/ Collager: Make a simple collage from shapes and images, describe it with a prompt, and watch as Artbreeder brings it to life. Splicer: lets you create images by mixing them together and editing their genes. Create portraits, landscapes, paintings, and more — then watch as others take your art in exciting new directions.

COST: Free/$7.50mo (Starter)/$16mo (Advanced)/$31mo (Advanced)

Magenta (Google AI)
https://magenta.tensorflow.org Make Music and Art using Machine Learning. An open source research project exploring the role of machine learning as a tool in the creative process. Review the blog, papers and sample demos. You can try the Magenta Studio plugins for Ableton Live or the standalone apps.

COST: Free beta

TOOLS: Desktop/Colab/Plugins/Apps

TOOLS: Online

Flair (beta)
https://flair.ai/ This tool looks quite promising (I’ve applied for the beta). The concept is to take your product images and the AI develops slick environments/settings/lighting and renders finished images for your marketing materials.

COST: Free (Private beta)

TOOLS: Online

Calligrapher AI
https://www.calligrapher.ai/ A very simple AI generated handwriting script designer tool. Some limitations such as kerning, etc. but quick results.

COST: Free

TOOLS: Online

Patterned AI
https://www.patterned.ai/ AI seamless pattern generator for textures, backgrounds and graphics. Create new patterns or explore generated patterns you can modify further. Royalty free with attribution (Free plan).

COST: Free (10 patterns)/$10 (100)

TOOLS: Online

Scribble Diffusion
https://scribblediffusion.com/ I’d have to classify this as more like entertainment than actual useful AI generation, but it can be fun to see how messed-up the results often are! Good for stirring up your creativity at least.

COST: Free

TOOLS: Online

PromptBase
https://promptbase.com/ An extensive library/store for professionally generated prompts for only a few bucks. A great starting point to build on for the looks you want to achive. While not an actual image generator, still a very helpful tool to get what you REALLY want to create in Midjourney, Dal-E and Leonardo AI generators listed above.

COST: Varies between the prompts

TOOLS: ONLINE Resource

————

AI Image & Video Enhancement Tools

^ main menu

Remini Web
https://app.remini.ai/ AI Photo and Video enhancer. Absolutely the best results for photo restoration on faces. I’ve yet to try the newest video enhancement options, but watch for those updates in my subsequent articles. New enhancements, options for background treatments and now works with Video.

COST: $18/mo (Personal)/$25/mo (Business) and more plans

TOOLS: Online

Magnific
https://magnific.ai/ AI Photo upscaler and enhancer. Advanced AI tech to achieve insanely high-res upscaling. Not only upscale, but enhance. Magnific can hallucinate and reimagine as many details as you wish guided by your own prompt and parameters.

COST: $39mo (Pro)/$99mo (Premium)/$299mo Enterprise

TOOLS: Online

Runway
https://runwayml.com/ Dozens of AI-powered creative tools to help you ideate, generate and edit content like never before. With new tools being added every week. There’s really nothing else like it – which is why it’s featured in two separate categories.

COST: Free/$12mo (Pro)/$28 (Team) and custom Enterprise plans

TOOLS: Online

Adobe Photoshop 2024
https://helpx.adobe.com/photoshop/using/generative-fill.html New AI tools inside of Photoshop such as updated Neural Filters, Intelligent Refine Edge, Generative Fill & Expand, AI Remove Tool, Sky Replacement and more.

COST: Beta available through your Adobe Creative Cloud portal

TOOLS: Desktop beta

DaVinci Resolve Studio 18
https://www.blackmagicdesign.com/products/davinciresolve Major updates adds new AI based tools, new Resolve FX, text based editing, speech to text and audio classification, new Cut page menus and Fusion USD support for faster workflows.

COST: Free (DaVinci Resolve 18)/$295 (DaVinci Resolve Studio 18)

TOOLS: Desktop App

Picture This (Intelligent Assistance)
https://intelligentassistance.com/picture-this-pp.html Call out stunning AI text-to-image artwork from Red Sequence  Markers in your Premiere Pro Sequences. Picture This… takes those markers and generates multiple image options for each prompt, and adds the selections directly to a new Sequence, with the image options on higher tracks, for Premiere Pro and FCP.

COST: $24.99/Mac App Store

TOOLS: MacOS

Simplified
Simplified.com A complete set of AI marketing tools for graphic design, social media, copywriting and video editing/generation in one online app.

COST: Free demo/Pricing varies across the tools/terms

TOOLS: Online

Latte
https://www.latte.social/Uses AI to select the most engaging parts of your video, then adds subtitles and reformats into vertical. Saving you hours of editing, and thousands in editor costs. (this one belongs to two categories as well – along with AI Video Generators below)

COST: Free trial/£10mo (Starter)/£40mo (Grow)/£90mo (Pro)

TOOLS: Online/iOS Mobile

AImages
https://aimages.ai/ Online AI video enhancement/clean/color and upres tool.

COST: Free 720p previews/€11mo (Standard)/€25mo (Premium)/€61mo (Elite) plans

TOOLS: Online

Deep Dream Generator
https://deepdreamgenerator.com/ Our AI image generator makes it easy to turn your photos or text into mesmerizing masterpieces in a variety of styles. With our advanced neural network, you’ll get stunning results instantly that keep getting better and better. Plus, our user-friendly interface is perfect for artists of all levels.

COST: Free trial/$19mo (Advanced)/$39mo (Pro)/$99mo (Ultra)

TOOLS: Online

Cleanup.pictures
https://cleanup.pictures/ It does one thing really well for such a simple tool – removes objects from photos. Using only a paintbrush tool (similar to the heal brush in Photoshop) it fills-in with AI to eliminate the selected subjects.

COST: Free 720dpi/$3mo/$7mo plans

TOOLS: Online/Mobile Apps (ClipDropPro)

Palette
https://palette.fm/ AI colorize B&W photos with various filters and/or textual input to determine the final look and feel of the colorized image.

COST: Free 500px/$6mo-$28mo HD plans

TOOLS: Online

Topaz Photo/Video AI
https://www.topazlabs.com/ A suite of AI desktop apps for auto-scaling, noise removal, sharpening and restoration of details and faces, There’s also a Video AI app that works great.

COST: $199 for the new Topaz Autopilot app. Others listed by product on website.

TOOLS: Desktop Apps

Vidyo.ai
https://vidyo.ai/ Edits-down long videos to short form videos using AI

COST: Free/$30mo (Pro)/$50 (Pro+)

TOOLS: Online

ColorGPT.app
https://chrome.google.com/webstore/detail/colorgpt/kmfgbheojkabgbebnimgibjkdpkenhhm

Generate, preview and copy beautiful colour palettes with the help of ChatGPT

COST: Free

TOOLS: Online

————

AI Audio Tools

^ main menu

Adobe Podcast
https://podcast.adobe.com/ several AI powered tools to create high-quality podcasts and professional voiceovers.

COST: Free

TOOLS: Online

Cleanvoice
https://cleanvoice.ai/ AI recorded speech scrubber – removes unwanted pauses, filler words like uhh/umm and mouth sounds,

COST: Free trial/subscriptions and pay-as-you-go plans

TOOLS: Online

Krisp
https://krisp.ai/ Real time AI noise cancelling, echo cancellation, HD voice quality (great for recording Zoom interviews and podcasts).

COST: Free demo/$8mo (Pro)/$10mo (Business)

TOOLS: Online

Podcastle
https://podcastle.ai/ Studio quality AI enhanced podcast recording/editing/sharing. Also has TTS & syntheses.

COST: Free basic/$12mo (Storyteller)/$24mo (Pro)

TOOLS: Online

FineVoice
https://www.fineshare.com/finevoice/ FineVoice is an AI-powered digital voice assistant that comes with a range of features, including a real-time voice changer, unlimited audio & sound effects, and a studio-quality voice recorder. FineVoice utilizes advanced speech processing algorithms to help you enhance and change your voice in real time, generate lifelike voices, and transcribe recordings.

COST: Free trial/$10mo/$40yr/$70 Lifetime

TOOLS: Online/Mobile

Voicemod
https://www.voicemod.net/ Voicemod adds real-time voice changing and custom sound effects to every game and communication desktop apps. Several apps/modules offer Voice Changer, Soundboard SFX, Text to Song and Tuna; a sound library.

COST: Free

TOOLS: Online/Desktop (Win)/Mobile

Vocal Remover & Isolation
https://vocalremover.org Separate voice from music out of a song free with powerful AI algorithms (It REALLY WORKS!) – Also, more tools for changing pitch and tempo of the song by adjusting musical key and bpm sliders, audio editing (cut & join), BPM & song key finder, and a Karaoke recorder using your mic.

COST: Free

TOOLS: Online

Moises.ai
Moises.ai  Take recorded music and remove vocals and key instruments, change timing and key – all using AI in their web portal, desktop apps and mobile apps. Great for musicians trying to learn a part or practice with the band! Use their AI tools to make your voice sound great and even mastering capabilities and lyric writing assistance. Plugins for your DAW coming soon.

COST: Free trial

TOOLS: Online/Desktop (MacOS-PC)/Mobile Apps

Seamless Communication Translation Demo (Meta AI)
https://seamless.metademolab.com/ Uses your microphone to record and translate text in both written and audio formats. This is a research demo supporting translation of nearly 100 input languages and 35 output languages.

COST: Free

TOOLS: Online

————

AI TTS (Text To Speech) Tools

^ main menu

ElevenLabs AI with Multilingual v2
https://beta.elevenlabs.io/ The best AI TTS tool out there with voice cloning and speech modifications & synthesis. Now available in several languages, Speech Classifier & synthesized Voice Library PLUS: New Diverse Default Voices and Professional Voice Cloning unlocked for Creator plans. Multilingual v2 comes with enhanced conversational capability, higher output quality, and the ability to better preserve each speaker’s unique voice characteristics across all languages. Supported languages: Bulgarian, Classical Arabic, Chinese, Croatian, Czech, Danish, Dutch, English, Filipino, Finnish, French, German, Greek, Hindi, Indonesian, Japanese, Italian, Korean, Malay, Polish, Portuguese, Romanian, Slovak, Spanish, Swedish, Tamil, Turkish & Ukrainian!

COST: Free/$5mo-$22mo plans

TOOLS: Online

WellSaid
https://wellsaidlabs.com/ Realistic sounding AI voices in a natural delivery for commercial, marketing and training productions.

COST: Free trial/$49mo-$199mo + Enterprise plans

TOOLS: Online

Murph.AI
https://murf.ai/ AI TTS tool with 100s of voices, styles, speed and editing options. Preview with your video.

COST: Free trial/$19mo (Basic)/$26mo (Pro)/$59mo (Enterprise)

TOOLS: Online

Play.HT
https://play.ht/ AI TTS tool with 100s of voices, styles, Voice Cloning and more. Emotions can be applied to any voice script on playback.

COST: Free trial/$32mo (Creator/Annual)/$80mo (Unlimited/Annual)/Enterprise (Custom)

TOOLS: Online

Revoicer
https://revoicer.com/ Emotion based natural human sounding AI TTS with controls of delivery and speed. Various languages and voices available.

COST: Free trial/$49mo-$199mo + Enterprise plans

TOOLS: Online

Paradiso AI
https://www.paradiso.ai/ With Paradiso AI Media Studio you can easily convert text to speech, transcribe speech to text, record your screen, translate text in multiple languages, and even create AI video avatars with human-like avatars

COST: Free trial/$25mo-$99mo plans/$250-$990 annual plans

TOOLS: Online

————

AI Text & Scripting Tools

^ main menu

ChatGPT
https://chat.openai.com/chat A natural language processing AI tool that responds to your questions or commands and delivers written content in the form of explanations/answers, writing letters/email, essays/white papers, stories and scripts and even code.

COST: Free basic/$20mo (ChatGPT Plus)

TOOLS: Online

Jasper AI
https://www.jasper.ai/ A generative AI platform for creative writing, ads, scripts, letters – all in stylized and human derived written form.

COST: Free trial/$40-$100 (usage plans) plus Custom plan for business

TOOLS: Online

Google Bard
https://bard.google.com/ Similar to ChatGPT, a natural language processing AI tool that responds to your questions or commands and delivers written content in the form of explanations/answers, writing letters/email, essays/white papers, stories and scripts and even code.

COST: Free

TOOLS: Online

Copy.AI
https://www.copy.ai/ A generative AI platform for creative writing, ads, scripts, letters – all in stylized and human derived written form.

COST: Free trial/Customizable usage rate plans

TOOLS: Online

Quillbot
https://quillbot.com/ AI Paraphrasing Tool for shortening long text blocks or articles/papers and stories.

COST: Free trial/$20mo or $140 yr (Premium)

TOOLS: Online

Writesonic
https://writesonic.com/ Creative writing AI tool – from generating ideas to refining your thoughts/stories or writing articles.

COST: Free trial/$13-$600mo (sliding scale based on content) – Plus custom plan option

TOOLS: Online

Moonbeam
https://www.gomoonbeam.com/ AI Paraphrasing Tool for shortening long text blocks or articles/papers and stories.

COST: Free trial/$15mo (Pro)/$50mo ea seat (Team)

TOOLS: Online

Thundercontent/Thunderchat 
https://thundercontent.com/ AI Writing & Text chat tools and AI audio tool options.

COST: Free trial/$39mo-$63mo and Annual plans

TOOLS: Online

————

AI Music Generators

^ main menu

Musicfy
https://musicfy.lol/ Use AI to create music with your voice and Leverage the latest in AI technology to supercharge your music.

COST: Free trial/$10mo (Starter)/$25mo (Professional)

TOOLS: Online

Suno.ai
Suno.ai This is the first Generative AI music creator I’ve seen to date that actually sounds like something! Type in a text prompt that includes the style and the topic and wait to be impressed!

COST: Free trial/$8mo (Pro)/$24mo (Premier) plus Enterprise

TOOLS: Online

Beatoven
https://www.beatoven.ai/ Royalty-free AI music track generator.

COST: Free basic/$20mo (Pro)

TOOLS: Online

Epidemic Sound
https://www.epidemicsound.com/ Royalty-free AI music track generator with unlimited access to our music and sound effects catalog for your videos, streams and podcasts. License comes with all necessary rights included.

COST: Free trial/$9mo (Personal)/$19mo (Commercial) plus Enterprise plans

TOOLS: Online

Soundraw
https://soundraw.io/ Royalty-free AI music track generator.

COST: Free trial/$17mo (Personal)

TOOLS: Online

SmartSound
https://www.smartsound.com/ Multilayer customizable music track generator.

COST: Pay per library/song (several packs/plans available)

TOOLS: Online/Desktop App

Aiva
https://aiva.ai/ Royalty-free AI music track generator.

COST: Free trial/e15mo (Standard)/e49mo (Pro) + annual plans

TOOLS: Online/Desktop App

Lyrical Labs
https://lyricallabs.io/ Write song lyrics with AI prompts in the style of song and artist.

COST: Free trial/$10mo (Hobbyist/$30mo (Songwriter)/$100mo (Pro)

TOOLS: Online

Jukebox (OpenAI)
https://openai.com/research/jukebox A neural net that generates music, including rudimentary singing, as raw audio in a variety of genres and artist styles. We’re releasing the model weights and code, along with a tool to explore the generated samples.

COST: Free (Exploration)

TOOLS: Online

MusicFLow
https://www.trymusicflow.com/ With musicflow, you don’t need to be a musician or producer. All you need is imagination. Simply type in your text prompt, and let our advanced AI transform it into a symphony, a rocking beat, or the next chart-topping melody.

COST: $49mo (Creator)/$99mo (Pro)

TOOLS: Online

SoundStripe
https://app.soundstripe.com/ AI Music, Video and SFX Search engine.

COST: $9.99mo (Creator)/$19.99mo (Pro) – Annual plan pricing (Enterprise avail)

TOOLS: Online

The Orb & David Gilmour (experimental)
https://metallicspheres.io/ Collaborate with AI & other fans to create unique album art and remix tracks based on Metallic Spheres in Colour from The Orb & David Gilmour, with original artwork by Simon Ghahary

COST: Free (Exploration)

TOOLS: Online

MusicLM (Google AI)
https://google-research.github.io/seanet/musiclm/examples/ A model generating high-fidelity music from text descriptions such as “a calming violin melody backed by a distorted guitar riff”. MusicLM casts the process of conditional music generation as a hierarchical sequence-to-sequence modeling task, and it generates music at 24 kHz that remains consistent over several minutes.

COST: Free (Exploration)

TOOLS: Online

Magenta (Google AI)
https://magenta.tensorflow.org Make Music and Art using Machine Learning. An open source research project exploring the role of machine learning as a tool in the creative process. Review the blog, papers and sample demos. You can try the Magenta Studio plugins for Ableton Live or the standalone apps.

COST: Free beta

TOOLS: Desktop/Colab/Plugins/Apps

————

AI Video Generators

^ main menu

Runway
https://runwayml.com/ Dozens of AI-powered creative tools to help you ideate, generate and edit content like never before. With new tools being added every week. There’s really nothing else like it – which is why it’s featured in two separate categories.

COST: Free/$12mo (Pro)/$28 (Team) and custom Enterprise plans

TOOLS: Online

Pika 1.0
https://pika.art/ Text to video clips/animation. Stunning results from the images/inputs you give it to create.

COST: Free (beta)

TOOLS: Online

Simplified
Simplified.com A complete set of AI marketing tools for graphic design, social media, copywriting and video editing/generation in one online app.

COST: Free demo/Pricing varies across the tools/terms

TOOLS: Online

Synthesia
https://www.synthesia.io/ AI Avatar based talking head video creator – including TTS and text editor or use your own video and graphics.

COST: Free/$30mo (Personal) and custom corporate plans

TOOLS: Online

D-ID Creative Reality Studio
https://www.d-id.com/ AI talking pictures (photos turned to talking avatars) as seen on MyHeritage. Uses TTS and template avatars, or models your photo to create a talking head video. (It’s a little creepy, but cool)

COST: Free trial/$6mo-$300mo plus custom corporate plans

TOOLS: Online

Invideo
https://invideo.io/ InVideo simplifies video creation with ready-made templates that you can quickly customize even if you’ve never done it before.

COST: Free Demo/$30mo (Business)/$60mo (Unlimited) – Save 50% for annual sub.

TOOLS: Online

Vidyo.ai
https://vidyo.ai/ Edits-down long videos to short form videos using AI

COST: Free/$30mo (Pro)/$50 (Pro+)

TOOLS: Online

FlexClip
https://www.flexclip.com/ Multi-purpose AI content creation and editing tool, including text to video & image generation, animated text/GIFs, text to speech, subtitles and more. Very intuitive and lots of templates and help to get started right away.

COST: Free Trial/$14mo (Plus)/$21mo (Business)

TOOLS: Online

Maverick
https://www.trymaverick.com/ Create personalized short video messages from your original video clip and use AI to replace the names.

COST: N/A without signup

TOOLS: Online

Descript
https://www.descript.com/ Full production AI video scripting, recording, editing and mixing tool. Script and record your talking head video, edit out the ums/uhs and add audio enhancements, mix in B-roll and graphics as needed and take edit notes from your team.

COST: Free trial/$12mo (Creator)/$24 (Pro) and custom corporate plans

TOOLS: Online

HeyGen
https://app.heygen.com Create AI animated avatars, video translations with lip sync, video templates and more with TTS Voices and more UPDATE: Video & voice cloned translations and 2.0 Avatar generation *SEE MY REVIEW HERE: https://www.provideocoalition.com/ai-tools-heygen-software-review/

COST: Free Demo/$48mo Creator/$144mo Business/Enterprise

TOOLS: Online

Colossyan Creator
https://www.colossyan.com/ Uses AI to generate TTS plus mouth movement on moving actors in either 1/2 body or face only avatars, plus allows you to design your backgrounds and text/graphics all on screen. Good idea but not the best TTS voices and they don’t really match the mouth movements as well as expected.

COST: Free trial/$21mo (Basic)/$70mo (Pro) and custom Enterprise plans

TOOLS: Online

Latte
https://www.latte.social/ Uses AI to select the most engaging parts of your video, then adds subtitles and reformats into vertical. Saving you hours of editing, and thousands in editor costs.

COST: Free trial/£10mo (Starter)/£40mo (Grow)/£90mo (Pro)

TOOLS: Online/iOS Mobile

Genmo v2 (Alpha)
https://alpha.genmo.ai/create This could actually be listed in the AI Image Generators category as it will take text to image generation requests, but more impressively, you can upload an existing image and give it a prompt to create a somewhat time-lapse animation between the original image state and an evolved/transformed state. This is Alpha so you need to sign up to test it.

COST: Free

TOOLS: Online

Adobe Express (Beta)
https://www.adobe.com/express/feature/video/animate/audio Animate stock characters by uploading a prerecorded voice track or directly record from your computer’s microphone.

COST: Free

TOOLS: Online

DeepBrain AI Studios
https://www.deepbrain.io/aistudios 99% Reality AI Avatar. Generate “realistic” AI simulation videos quickly and easily. Simply prepare your script and use our Text-to-Speech feature to receive your first AI video in 5 minutes or less.

COST: Free trial/$29mo (Starter)/Custom enterprise plans

TOOLS: Online

Lumen5
https://lumen5.com/ Creating with Lumen5 is just like making a presentation. Point and click, drag and drop, done and done.

COST: Free trial/$19mo (Basic)/$59mo (Starter)/$149mo (Pro)

TOOLS: Online

Kaiber
https://www.kaiber.ai/ Start with an uploaded image or text to create a short video animation.

COST: Free trial/$10mo (Pro) plus studio/enterprise plans

TOOLS: Online

Verbilate
https://verbalate.ai/ Video translation and lip sync software. Reach a global audience, unlock new revenue, and scale your video content production.

COST: $9mo (Starter)/$49mo (Creator)/$749mo (Producer)

TOOLS: Online

————

AI 3D Tools

^ main menu

Move.ai
https://www.move.ai/ Capture HD motion anywhere using standard cameras. This technology enables motion capture in any environment using off-the-shelf cameras, mobile phones, computer vision and deep learning. Set up in minutes, shoot anywhere and perfectly digitize any movement for export into every game engine.

COST: Beta/$1 day

TOOLS: Online/Mobile

Luma Imagine 3D
https://captures.lumalabs.ai/imagine Prototype and create 3D with text. 3D models created with iPhone captures.

COST: Free (access to generation expanding to waitlist)

TOOLS: Online/Mobile App

Video to 3D API (LumaLabs)
https://lumalabs.ai/luma-api for developers of apps, games and VFX plugins, this API tool will help you achieve photorealistic NeRF renders quickly.

COST: $1 per capture

TOOLS: API for developers

Flythroughs (LumaLabs)
https://lumalabs.ai/flythroughs Create 3D Generative NeRF environments and objects and animate a flythrough animation with your iPhone.

COST: Free

TOOLS: iOS

Make Image 3D
https://make3d.app/ Converts 2D image to embossed 3D depth image using your reference image.

COST: Free/Beta

TOOLS: Online

Kaedim
https://www.kaedim3d.com/ Uses machine learning to generate 3D models from 2D art and images. Edit and export your completed 3D models.

COST: $3 (30-day limited trial)/$30 (30-day premium trial) – $150mo and up!

TOOLS: Online

Point-E
https://github.com/openai/point-e Creates an AI generated point cloud model from text-to-3D prompting.

COST: Free/Beta download

TOOLS: Local/Server

Wonder Studio
https://wonderdynamics.com/ An AI tool that automatically animates, lights and composes CG characters into a live-action scene. Pretty amazing technology – watch the demo video here.

COST: Closed beta

TOOLS: Mixed

————

AI Utilities & Productivity Tools

^ main menu

CLIP Interrogator
https://huggingface.co/spaces/pharma/CLIP-Interrogator Want to figure out what a good prompt might be to create new images like an existing one? The CLIP Interrogator is here to get you answers! Upload a photo or illustration and it will provide text prompts you can use in your image generator.

COST: Free

TOOLS: Online

Namelix
https://namelix.com/ This clever AI tool helps you brainstorm a new business name (or product/service, etc.) by supplying the info prompts and delivers dozens of brandable ideas in return. I think it does a great job.

COST: Free to generate with multiple registration fees and professional services.

TOOLS: Online

Checksub
https://www.checksub.com/ Subtitle, Caption and Translate your videos in minutes. Reach more people with your videos thanks to the Checksub platform. Add subtitles, translate and dub your videos automatically.

COST: Free trial/$12mo (Junior)/Business plan available

TOOLS: Online

Brandmark
https://brandmark.io/ From the same people who make Namelix, Brandmark develops unique and brandable logos.

COST: Free to design/$25 basic (one-time)/$65 Designer/$175 Enterprise

TOOLS: Online

Looka
https://looka.com/ AI Logo design generator with customization and previews in use.

COST: Free to design/$20 (Basic logo package) to $192 (Brand Kit Web Subscription)

TOOLS: Online

Watermark Remover
https://www.watermarkremover.io/ Magically removes embedded watermarks using AI. (Useful for AI generated images that include watermarks or stray text). – I do question the ethical nature of this as a photographer though.

COST: Free/$15mo (1 member) up to $159mo (team up to 50)

TOOLS: Online

Ocoya
https://www.ocoya.com/ Uses AI to help you design, write and create content for social media including scheduling ad runs and posts all in one location.

COST: Free trial/$29mo/$89mo/$299mo

TOOLS: Online

PromptBase
https://promptbase.com/ An extensive library/store for professionally generated prompts for only a few bucks. A great starting point to build on for the looks you want to achive. While not an actual image generator, still a very helpful tool to get what you REALLY want to create in Midjourney, Dal-E and Leonardo AI generators listed above.

COST: Varies between the prompts

TOOLS: ONLINE Resource

————

AI Resources

^ main menu

There’s an AI for that
https://theresanaiforthat.com/ An overwhelmingly current directory all things AI. There’s also a community page you can join to contribute or have discussions/questions.

A very unofficial Midjourney manual
https://docs.google.com/document/d/1ivAYy_JXJsGE-9Rh97iMyXkWlmF_MxO2NFshrIvuns4/edit Word Doc that’s always updated that has tons of info on using Midjourney, with prompting tips, instructions and more.

Emotion Prompts
https://rentry.org/yfcd5 A simple list of accepted emotional prompts and emojis.

Have I Been Trained?
https://haveibeentrained.com/ Are you an artist or photographer with lots of images online? Is your work in part of an online stock library? Use this tool to add your image URL or upload it to see if it’s been used in one of the machine learning libraries.

AI and Music: What Musicians Should Know!
https://diymusician.cdbaby.com/music-career/ai-music/ Can artificial intelligence help you find gigs, write a press release, or design your album cover? Could AI even finish a lyric you’ve been stuck on for months or plug holes in your music marketing strategy?

Alpha Signal – Weekly Summary of Machine Learning
https://alphasignal.ai/latest-summary Deep level news about what is hot, what’s new and what’s changed or updated in AI apps and technology.

Flawless AI
https://www.flawlessai.com/ A world-first system unleashes the power of VISUAL DUBBING. Opening up a new world of possibilities, from fast and efficient AI RESHOOTS to the creation of immersive, authentic, perfectly lip-synced VISUAL TRANSLATIONS. To keep a PG-13 rating, the creative team behind 2022’s Fall had to digital replace expletive-filled dialogue. But the technology behind it is crucial for an international market.

What is Google Colab: A Beginner’s Guide
https://bytexd.com/what-is-google-colab-a-beginner-guide/ In this article we’ll cover what Google Colab is, in a beginner friendly way, how to use it, and some of its most popular features so you can get started more easily with this platform.

How to use Stable Diffusion for Free on Google Colab
https://decentralizedcreator.com/use-stable-diffusion-for-free/ Unlike, other AI text-to-image models, you can use Stable Diffusion on your PC. However, it requires a basic knowledge of Git and Miniconda3 installation. Also, a system requirement 3xxx series NVIDIA GPU with at least 6GB of RAM is required to get good results from Stable Diffusion.

How to use Disco Diffusion for Free on Google Colab
https://decentralizedcreator.com/use-disco-diffusion-for-free/ Disco Diffusion is one of the machine learning models that convert text to image. With Disco Diffusion, you can not only create images from prompts but also videos! This AI art generator is similar to Stable Diffusion.

Disco Diffusion Resources Download
https://github.com/alembics/disco-diffusion A frankensteinian amalgamation of notebooks, models and techniques for the generation of AI Art and Animations.

Disco Diffusion v5.7 Updates Download
https://colab.research.google.com/github/alembics/disco-diffusion/blob/main/Disco_Diffusion.ipynb

Vid2Avatar
https://moygcc.github.io/vid2avatar/ 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decomposition

MuseNet (OpenAI)
https://openai.com/research/musenet A deep neural network that can generate 4-minute musical compositions with 10 different instruments, and can combine styles from country to Mozart to the Beatles. MuseNet was not explicitly programmed with our understanding of music, but instead discovered patterns of harmony, rhythm, and style by learning to predict the next token in hundreds of thousands of MIDI files. MuseNet uses the same general-purpose unsupervised technology as GPT-2, a large-scale transformer model trained to predict the next token in a sequence, whether audio or text.

AI-Duet (Google AI Magenta)
https://experiments.withgoogle.com/ai-duet 3D Avatar Reconstruction from Videos in the Wild via Self-supervised Scene Decomposition

Google Deepdream
https://github.com/google/deepdreamhttps://github.com/google/deepdream

This repository contains IPython Notebook with sample code, complementing Google Research blog post about Neural Network art. See original gallery for more examples. You can view “dream.ipynb” directly on github, or clone the repository, install dependencies listed in the notebook and play with code locally.

Gen-1 (Runway Research) The Next Step Forward for Generative AI
https://research.runwayml.com/gen1

OpenAI Whisper
https://openai.com/research/whisper trained and open-sourced a neural net called Whisper that approaches human level robustness and accuracy on English speech recognition.

Seyhan Lee – Cuebric 
https://seyhanlee.com/ Cuebric allows filmmakers, concept artists, and production studios to create stunning, fully segmented, inpainted, virtual environments in seconds. A quick and cost-effective alternative and partner to CGI VFX production processes.

————

New Technology & Video Resources

NEW! DreaMoving sandbox
https://huggingface.co/spaces/jiayong/Dreamoving

Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold
https://vcai.mpi-inf.mpg.de/projects/DragGAN/

Getting Started in Midjourney

Midjourney Settings Explained – EASY Guide with Sample Images

Midjourney AI – First Steps – Easy Beginner’s Guide

ChatGPT & Midjourney: One Prompt to Transform Imagination

Make Better Prompts – Midjourney AI

Stable Diffusion Version 2: Power to the People… for Free!

A Beginners Guide to Machine Learning with ml5.js

AI and Image Generation (Everything is a Remix Part 4)

Promptcraft: Learn the Language of Prompt Writing for Generative Creatives
https://amoration.square.site/

————

UPDATE: AI Tools Part 2: A Deeper Dive

UPDATE: AI Tools Part 3: The Current State of Generative AI Tools

UPDATE: AI Tools Part 4: The Latest for Video, Film Production, 3D, Audio and more…

UPDATE: AI Tools Part 5: 2023 A Year in Review

Exit mobile version