The AI company ElevenLabs has launched a new service, Eleven Music, that allows users to create original songs from text prompts. According to an article by Belle Lin for The Wall Street Journal, the company aims to avoid legal issues by training its model on licensed music. ElevenLabs CEO Mati Staniszewski said the startup secured …
Adobe is expanding its Firefly generative AI tools with new features for video creation. As reported by Sabrina Ortiz for ZDNet, users can now generate custom sound effects from text descriptions. A unique aspect of this tool allows creators to record their own voice to guide the timing and intensity of the generated audio. Another …
French AI company Mistral has released Voxtral, its first family of open-source AI models for audio processing. The company positions Voxtral as a solution for developers who previously had to choose between less reliable open-source systems and expensive, closed proprietary models. Mistral claims Voxtral offers high performance at “less than half the price” of comparable …
Apple has introduced new speech recognition technology that significantly outperforms existing transcription tools in processing speed. The company unveiled SpeechAnalyzer and SpeechTranscriber as part of its developer beta releases at WWDC. John Voorhees from MacStories tested the new Apple framework against popular transcription apps built on OpenAI’s Whisper model. His tests used a 34-minute, 7GB …
ElevenLabs has released Conversational AI 2.0, an enhanced platform for building enterprise voice assistants that better simulate human dialogue patterns. The update addresses common issues like awkward pauses and interruptions in automated conversations, according to reporting by Carl Franzen. The new system analyzes conversational cues such as hesitations and filler words to determine when to …
New York startup Hume has launched EVI 3, an advanced conversational AI model that lets users create custom synthetic voices through voice-to-voice interaction. The technology targets applications from customer support to virtual companionship, according to reporting by Carl Franzen for VentureBeat. Users can specify personality traits, vocal qualities, and emotional tones to generate voices ranging …
Nvidia has launched a new open-source automatic speech recognition (ASR) model called Parakeet-TDT-0.6B-v2. According to VentureBeat reporter Carl Franzen, the model can transcribe 60 minutes of audio in just one second when running on Nvidia’s GPU hardware. The new model currently tops the Hugging Face Open ASR Leaderboard with a word error rate of only …
A startup called Nari Labs has released Dia, a new open-source text-to-speech model designed to produce naturalistic dialogue. According to VentureBeat reporter Carl Franzen, the 1.6 billion parameter model rivals offerings from ElevenLabs, OpenAI, and Google’s NotebookLM. Co-creator Toby Kim developed Dia “with zero funding” and Google’s support through access to TPU chips. The model …
Groq and PlayAI have partnered to create Dialog, a text-to-speech system that delivers more natural-sounding voice AI. According to Michael Nuñez of VentureBeat, the system combines PlayAI’s voice technology with Groq’s high-speed inference platform. Dialog features an “adaptive speech contextualizer” that maintains awareness of conversation flow, allowing responses with appropriate tone and emotion. The system …
OpenAI has introduced three new AI models designed to enhance speech-to-text and text-to-speech capabilities. The models gpt-4o-transcribe, gpt-4o-mini-transcribe, and gpt-4o-mini-tts offer improved accuracy and customization options for developers building voice applications. According to OpenAI, the new transcription models significantly outperform their predecessor, Whisper, particularly in noisy environments and with various accents. The company’s internal benchmarks …