Artificial intelligence models are facing significant degradation due to excessive use of synthetic training data, according to Rick Song, CEO of Persona, writing in VentureBeat. This phenomenon, known as “model collapse” or “model autophagy disorder,” occurs when AI systems are repeatedly trained on artificially generated content rather than human-created data. The practice can lead to …
A comprehensive analysis published by SemiAnalysis, authored by Dylan Patel and colleagues, reveals that artificial intelligence scaling laws remain robust despite recent skepticism. The report details how major AI labs are finding new ways to improve model performance beyond traditional pre-training methods. The analysis specifically examines OpenAI’s O1 Pro architecture and explains various scaling approaches …
Microsoft has introduced a new AI model that delivers superior mathematical reasoning capabilities while using significantly less computing power than larger competitors. According to Michael Nuñez’s report in VentureBeat, the 14-billion-parameter Phi-4 model outperforms larger systems like Google’s Gemini Pro 1.5. The model excels particularly in mathematical problem-solving, achieving top scores on standardized math competition …
Microsoft has developed a new data center cooling system that eliminates the need for fresh water consumption, according to a report by Dina Bass for Bloomberg. The innovative “closed loop” design, launched in August 2024, will replace conventional cooling methods that typically use 125 million liters of water annually per facility. The company plans to …
Japanese researchers made fundamental contributions to artificial neural networks that helped establish modern AI, yet their work has been largely overlooked in Western narratives. According to an article by Hansun Hsiung published by The Conversation, scientists like Shun’ichi Amari and Kunihiko Fukushima developed crucial early innovations in machine learning during the 1960s and 70s. Fukushima …
Google has announced a new AI model called PaLiGemma 2 that reportedly can identify human emotions in images, according to tech journalist Kyle Wiggers writing for TechCrunch. The system requires specific fine-tuning to perform emotion recognition and has sparked concern among AI ethics experts. Sandra Wachter, professor at the Oxford Internet Institute, warns that attempting …
Large language models frequently generate false information, but researchers and companies have developed effective mitigation strategies, according to a comprehensive analysis by Emil Sorensen. The report outlines nine technical approaches across input, design, and output layers to reduce these AI “hallucinations” – instances where AI systems confidently produce incorrect information. These strategies include query optimization, …
MIT startup Liquid AI has developed a new AI framework called STAR (Synthesis of Tailored Architectures) that significantly improves upon traditional Transformer models. As reported by Carl Franzen for VentureBeat, the system uses evolutionary algorithms to automatically generate and optimize AI architectures. The STAR framework achieved a 90% reduction in cache size compared to traditional …
The artificial intelligence industry is grappling with potential limitations in scaling larger language models (LLMs), according to an analysis by Gary Grossman, EVP of technology practice at Edelman. While recent reports suggest that developing more extensive AI models like GPT-5 may face diminishing returns, industry leaders including OpenAI’s Sam Altman and former Google CEO Eric …
Indigenous technologists are working to save their rapidly disappearing languages using artificial intelligence technology. Michael Running Wolf, founder of Indigenous in AI, leads an initiative at the Mila-Quebec Artificial Intelligence Institute to develop speech recognition models for over 200 endangered Native American languages, as one Indigenous language dies every two weeks globally. The effort faces …