Meta introduces new memory layer technology for AI models

Meta has developed a new technology called scalable memory layers to improve knowledge retention and reduce hallucinations in large language models. As reported by Ben Dickson in VentureBeat, this innovation adds parameters to AI models without increasing computational demands. The memory layers work by using sparse activations and key-value lookup mechanisms, making them more efficient … Read more

Meta tests AI-generated self-images in Instagram feeds

Meta has begun testing a feature that automatically generates AI images of Instagram users and displays them in their personal feeds. According to Jason Koebler from 404 Media, the feature creates scenarios based on users who have previously utilized Meta’s “Imagine Yourself” AI tool. A Reddit user first reported seeing AI-generated images of himself in … Read more

Meta removes AI profiles after controversial interactions

Meta has discontinued its AI-powered social media profiles following problematic interactions with users. According to journalist Johana Bhuiyan’s report in The Guardian, the company deleted 28 AI personas that were created in September 2023. These profiles, which included characters like “Liv,” a self-described Black queer mother, sparked controversy when users discovered the AI’s development team … Read more

Meta plans AI-generated characters across social platforms

Meta is developing AI tools to create virtual characters that will populate its social media platforms, according to a report by Cristina Criddle and Hannah Murphy in the Financial Times. The company aims to integrate AI-generated profiles that can interact with its 3 billion users across Instagram and Facebook. Connor Hayes, Meta’s vice president of … Read more

Meta introduces new byte-based language model architecture

Meta and the University of Washington have developed a new AI architecture called Byte latent transformer (BLT) that processes language without traditional tokenization. As reported by Ben Dickson for VentureBeat, BLT works directly with raw bytes instead of predefined tokens, making it more versatile and efficient. The system uses three transformer blocks: two lightweight encoder/decoder … Read more

Meta launches Video Seal for AI video watermarking

Meta has introduced a new open-source tool called Video Seal that adds invisible watermarks to AI-generated videos. According to Kyle Wiggers from TechCrunch, this development comes as deepfakes have increased fourfold worldwide from 2023 to 2024. The tool can embed hidden messages within videos to track their origins and is designed to withstand common editing … Read more

Meta’s Llama 3.3 70B model runs GPT-4 level AI on high-end laptops

Meta has released Llama 3.3 70B, a new large language model that achieves GPT-4 level performance while running on high-end consumer laptops. The breakthrough was documented by developer Simon Willison testing the model on a 64 GB MacBook Pro M2, demonstrating capabilities comparable to much larger models like Meta’s own Llama 3.1 405B. The model … Read more

Meta plans massive AI data center in Louisiana

Meta Platforms is investing $10 billion to build its largest data center to date in Louisiana’s Richland Parish, according to a Reuters report by Priyanka G and Seher Dareen. The hyperscaler facility, designed to process AI workloads, will be powered by renewable energy through a partnership with utility provider Entergy. Construction is set to begin … Read more

Meta uses OpenAI’s GPT-4 alongside Llama in internal coding tool

Meta’s internal coding assistant Metamate combines both OpenAI’s GPT-4 and Meta’s own Llama AI model to support developers, according to a report by Kali Hays in Fortune. The tool has been using GPT-4 since early 2024, despite CEO Mark Zuckerberg’s public promotion of Llama as a leading AI model. Current and former Meta employees, speaking … Read more

Tech giants collaborate on African language AI models

OpenAI, Meta, and Orange are partnering to develop artificial intelligence models for African languages, starting with Wolof and Pulaar in West Africa. According to reporting by Loni Prinsloo and Jillian Deutsch for Bloomberg, the initiative will launch in the first half of 2025 and aims to address the lack of AI language models for Africa’s … Read more