Lost in translation no more: ElevenLabs takes AI dubbing to the next level

AI company ElevenLabs has released Dubbing v2, a new dubbing model that transfers a speaker’s emotional delivery and tone into more than 90 languages. Imogen Mulliner and Jakub Lichman write for ElevenLabs that the system conditions directly on the original audio performance rather than relying on a transcript alone. Traditional AI dubbing tools work primarily …

Read more

Genre-hopping, rap, sound effects: ElevenLabs raises the bar for AI music generation

ElevenLabs has launched Music v2, a new version of its AI music-generation model that can switch between genres within a single track. Ivan Mehta reports for TechCrunch that the model is built to handle complex vocals and compositions, arriving nearly ten months after the company released its first music-generation model. According to ElevenLabs, the model …

Read more

ElevenLabs challenges Spotify and Audible with a new audiobook platform

ElevenLabs, the AI voice company valued at $11 billion, is entering the audiobook streaming market in direct competition with Spotify and Audible. Ashley Carman reports for Bloomberg that the startup has licensed 200,000 human-voiced audiobooks from publishers including HarperCollins, Blackstone Publishing, and Vinci Books. The titles will be available through ElevenReader, the company’s existing app …

Read more

ElevenLabs releases album with Liza Minnelli and Art Garfunkel created using AI

ElevenLabs has launched “The Eleven Album,” featuring original music from established artists including Liza Minnelli and Art Garfunkel, created in collaboration with the company’s AI music generation system. The project marks one of the first large scale partnerships between artificial intelligence technology and professional musicians, Todd Spangler reports for Variety. The album features tracks across …

Read more

Matthew McConaughey and Michael Caine partner with AI voice company

Actors Matthew McConaughey and Michael Caine have partnered with AI audio company ElevenLabs to create digital replicas of their voices. Todd Spangler reports for Variety. McConaughey is investing in the New York-based company and using its technology to produce a Spanish-language version of his newsletter “Lyrics of Livin’” in his own voice. He has worked …

Read more

Filmmaker creates popular sci-fi universe with AI tools

Filmmaker Josh Kerrigan has created a successful sci-fi web series called Neural Viz using a variety of generative artificial intelligence tools. Christopher Beam reports for Wired that the project is considered one of the first examples of high-quality AI filmmaking. The series stands out in a field often associated with low-effort content. Kerrigan’s project, known …

Read more

Yelp now uses AI to generate video summaries for businesses

Yelp is automatically creating short videos about restaurants and other businesses using generative artificial intelligence. According to a report by The Verge, this feature is now available nationwide in the United States on Yelp’s iOS app. The system combines photos and videos uploaded by users to create a short, narrated clip. Generative AI models from …

Read more

AI startup ElevenLabs releases music generator trained on licensed data

The AI company ElevenLabs has launched a new service, Eleven Music, that allows users to create original songs from text prompts. According to an article by Belle Lin for The Wall Street Journal, the company aims to avoid legal issues by training its model on licensed music. ElevenLabs CEO Mati Staniszewski said the startup secured …

Read more

ElevenLabs’ upgraded voice AI mimics natural conversation flow

ElevenLabs has released Conversational AI 2.0, an enhanced platform for building enterprise voice assistants that better simulate human dialogue patterns. The update addresses common issues like awkward pauses and interruptions in automated conversations, according to reporting by Carl Franzen. The new system analyzes conversational cues such as hesitations and filler words to determine when to …

Read more

AI voice cloning tools lack effective safeguards against misuse

Most AI voice cloning services have inadequate protections against nonconsensual voice impersonation, according to a Consumer Reports investigation. The study examined six leading publicly available tools and found that five had easily bypassed safeguards. As reported by NBC News, four services (ElevenLabs, Speechify, PlayHT, and Lovo) merely require checking a box confirming authorization, while Resemble …

Read more

×