Meta introduces new byte-based language model architecture

Meta and the University of Washington have developed a new AI architecture called Byte latent transformer (BLT) that processes language without traditional tokenization. As reported by Ben Dickson for VentureBeat, BLT works directly with raw bytes instead of predefined tokens, making it more versatile and efficient. The system uses three transformer blocks: two lightweight encoder/decoder … Read more

Meta launches Video Seal for AI video watermarking

Meta has introduced a new open-source tool called Video Seal that adds invisible watermarks to AI-generated videos. According to Kyle Wiggers from TechCrunch, this development comes as deepfakes have increased fourfold worldwide from 2023 to 2024. The tool can embed hidden messages within videos to track their origins and is designed to withstand common editing … Read more

Meta’s Llama 3.3 70B model runs GPT-4 level AI on high-end laptops

Meta has released Llama 3.3 70B, a new large language model that achieves GPT-4 level performance while running on high-end consumer laptops. The breakthrough was documented by developer Simon Willison testing the model on a 64 GB MacBook Pro M2, demonstrating capabilities comparable to much larger models like Meta’s own Llama 3.1 405B. The model … Read more

Meta plans massive AI data center in Louisiana

Meta Platforms is investing $10 billion to build its largest data center to date in Louisiana’s Richland Parish, according to a Reuters report by Priyanka G and Seher Dareen. The hyperscaler facility, designed to process AI workloads, will be powered by renewable energy through a partnership with utility provider Entergy. Construction is set to begin … Read more

Meta uses OpenAI’s GPT-4 alongside Llama in internal coding tool

Meta’s internal coding assistant Metamate combines both OpenAI’s GPT-4 and Meta’s own Llama AI model to support developers, according to a report by Kali Hays in Fortune. The tool has been using GPT-4 since early 2024, despite CEO Mark Zuckerberg’s public promotion of Llama as a leading AI model. Current and former Meta employees, speaking … Read more

Tech giants collaborate on African language AI models

OpenAI, Meta, and Orange are partnering to develop artificial intelligence models for African languages, starting with Wolof and Pulaar in West Africa. According to reporting by Loni Prinsloo and Jillian Deutsch for Bloomberg, the initiative will launch in the first half of 2025 and aims to address the lack of AI language models for Africa’s … Read more

Meta rebuilds company strategy around open-source AI model Llama

Meta has fundamentally transformed its business strategy by focusing on Llama, its open-source artificial intelligence model. According to Sharon Goldman’s detailed report in Fortune, CEO Mark Zuckerberg made the pivotal decision to release Llama 2 as open-source in July 2023, despite internal concerns about monetization and security risks. The model has since been downloaded over … Read more

Meta creates new AI division for business tools

Meta is establishing a new product group dedicated to developing AI tools for the 200 million businesses using its platforms, Sara Fischer reports for Axios. Former Salesforce AI CEO Clara Shih will lead the initiative as VP of business AI, focusing on creating and monetizing AI solutions for business users. The group aims to build … Read more

Meta’s former AR/VR hardware lead joins OpenAI to head robotics efforts

Caitlin Kalinowski, the former head of Meta’s augmented reality glasses and virtual reality goggles teams, announced that she is joining OpenAI to lead their robotics and consumer hardware division. In a LinkedIn post, Kalinowski stated her initial focus will be on bringing AI into the physical world through robotics work and partnerships. An article by … Read more

Meta makes Llama AI models available for US defense applications

Meta is making its Llama AI models available to U.S. government agencies and contractors working on defense and national security applications. According to a blog post by Meta cited by TechCrunch, the company is partnering with firms like Accenture, Amazon Web Services, and Lockheed Martin to bring Llama to these entities. The move comes after … Read more