Microsoft’s VASA-1 can make human portraits sing and talk. It only needs a still image and an audio file with speech to generate moving lips, matching facial expressions and head movements. Microsoft emphasizes that this is a research demonstration only, with no plans to bring it to market.
Adobe plans to add plug-ins for third-party AI video generators such as OpenAI’s Sora, Runway ML’s Gen-2, and Pika 1.0 to its Premiere Pro video editing software. This integration would allow users to seamlessly combine and edit footage shot on traditional cameras with AI-generated content. Adobe is also announcing a version of its proprietary Firefly …
Google unveiled a series of updates to its enterprise AI offerings at its annual cloud computing conference in Las Vegas. Despite recent troubles with consumer-facing tools, the company insisted the technology is safe and ready for enterprise use. Google Cloud CEO Thomas Kurian demonstrated how its most powerful AI model, Gemini, can be used for …
Eggnog enables AI-generated videos with consistent characters. First you create the person, including outfits, then you storyboard the planned scenes of the clip, and finally you create the video. Eggnog aims to become the “YouTube for AI videos”. Sources: TechCrunch, Y Combinator
Pika already offers a “lip sync“ feature that makes people speak in generated videos. Now there is an option to add sound to a generated clip, such as background noises and effects. Source: VentureBeat
While many AI videos are only a few seconds long, Story.com allows up to 1 minute. A storyboarding feature is supposed to ensure that the clips ultimately meet the user’s ideas and needs.
The service has caused a stir with its test videos, which promise a significant leap in quality. Source: The Verge
The research project EMO from China makes a photo (or a graphic or a painting like the Mona Lisa) talk and sing. The facial expressions are quite impressive, the lip movements not always. Unfortunately, there is no way to try EMO for yourself.
AI video generator Pika shows off its lip sync feature that makes people speak in AI videos. The voice is either pre-recorded or created from text using Elevenlabs’ AI. The feature is currently only available to paying “Pro” users. Read more on VentureBeat.
OpenAI has caused quite a stir with a preview of the video AI “Sora”. The examples on the official website are indeed impressive. However, without our own tests, it is not yet possible to make a meaningful assessment of how well Sora works in everyday life and what the video clips can be used for. …