SCRGoogle will back the construction of seven small nuclear reactors in the U.S. to power its growing AI operations, according to Jennifer Hiller in the Wall Street Journal. The tech giant has agreed to purchase the power generated by the reactors, which will be built by nuclear startup Kairos Power. The deal aims to add …
A Large Language Model, commonly abbreviated as LLM, is an advanced artificial neural network designed to understand, generate, and process human language. These models are termed “large” because they are trained on vast amounts of textual data and can contain billions of parameters. LLMs are capable of performing a wide range of tasks, including text …
OpenAI has unveiled “Swarm,” an experimental framework for networks of AI agents, according to VentureBeat. Swarm allows developers to create interconnected AI networks that can communicate and solve tasks autonomously. The framework has potential applications in automating various business functions, from market analysis to customer support. However, it also raises ethical concerns regarding security, bias, …
Adobe unveiled a host of new AI capabilities for video production, image editing, vector graphics and marketing teams. At its annual MAX conference, the company introduced the Firefly Video Model. According to Adobe, this AI system can generate videos from text descriptions or images. It can also be used to enhance existing video clips. Adobe …
Decentralized training of a 10-billion-parameter model called INTELLECT-1 has begun. Anyone can contribute computing power and participate. INTELLECT-1 is based on the Llama-3 architecture and is trained on a high quality open source dataset called Fineweb-Edu by Hugging Face. The dataset contains over six trillion tokens and consists of Fineweb-edu (55%), DLCM (20%), Stack v2 …
Yann LeCun, a key figure in the development of modern artificial intelligence, expresses skepticism about the current hype surrounding AI capabilities. He believes that many experts are overstating the potential and risks associated with AI, arguing that it is not as advanced as some claim. LeCun positions himself as a critical voice amid the prevailing …
AI21 CEO Ori Goshen criticizes Transformer models as unsuitable for AI agents. They are too expensive and inefficient, Goshen told VentureBeat in an interview. Alternatives like Mamba and Jamba offer faster inference times and longer context. This makes them more suitable for agents that need to access multiple models. Goshen attributes the lack of reliability …
Dario Amodei’s essay explores the transformative potential of powerful AI, emphasizing that while risks are significant, the upside could radically improve human life. He argues that discussions about AI often overlook its positive applications, which include advancements in biology, neuroscience, economic development, governance, and the meaning of work. Amodei posits that powerful AI could accelerate …
A new study from Apple reveals that large language models (LLMs) don’t reason logically but rely on pattern recognition. This finding, published by six AI researchers at Apple, challenges the common understanding of LLMs. The researchers discovered that even small changes, such as swapping names, can alter the models’ results by about 10%. Gary Marcus, …
The market for Nvidia’s H100 GPUs has gone from a shortage last year to a glut in 2024. According to Eugene Cheah, rental prices for the powerful GPUs have dropped from $8 per hour to less than $2. Cheah attributes this to a number of factors. For example, more companies are relying on fine-tuning existing …