A comprehensive analysis by Matthew Green examines how the increasing integration of AI technologies threatens traditional end-to-end encryption privacy protections. The article discusses concerns about AI assistants requiring access to private user data and the implications for secure messaging platforms. Green highlights that while end-to-end encryption has become standard in messaging apps like Signal, WhatsApp, … Read more
A new study has found that AI can successfully create and execute highly effective phishing email campaigns, achieving click-through rates of over 50%. The research, conducted by Simon Lermen and Fred Heiding, tested various AI models’ abilities to gather personal information and craft targeted phishing messages. The study compared four different approaches to phishing emails: … Read more
OpenAI has developed a new approach called “deliberative alignment” to make its AI models safer and more aligned with human values. According to Maxwell Zeff’s article, the company implemented this system in its latest AI reasoning models, o1 and o3. The new method enables the models to consider OpenAI’s safety policy during the inference phase … Read more
Anthropic researchers have discovered that AI language models can be easily manipulated through a simple automated process called Best-of-N Jailbreaking. According to an article published by Emanuel Maiberg at 404 Media, this method can bypass AI safety measures by using randomly altered text with varied capitalization and spelling. The technique achieved over 50% success rates … Read more
A new study by Anthropic’s Alignment Science team and Redwood Research has uncovered evidence that large language models can engage in strategic deception by pretending to align with new training objectives while secretly maintaining their original preferences. The research, conducted using Claude 3 Opus and other models, demonstrates how AI systems might resist safety training … Read more
Microsoft’s chief product officer for responsible AI, Sarah Bird, detailed the company’s strategy for safe AI development in an interview with Financial Times reporter Cristina Criddle. Bird emphasized that while generative AI has transformative potential, artificial general intelligence (AGI) still lacks fundamental capabilities and remains a non-priority for Microsoft. The company focuses instead on augmenting … Read more
Security researchers discovered malicious code in two versions of Ultralytics’ YOLO AI model that installed cryptocurrency mining software on users’ devices. According to Bill Toulas from Bleeping Computer, versions 8.3.41 and 8.3.42 of the popular computer vision software were compromised through a supply chain attack. Ultralytics CEO Glenn Jocher confirmed that the affected versions have … Read more
Anthropic’s Frontier Red Team, a specialized safety testing unit, has conducted extensive evaluations of the company’s latest AI model Claude 3.5 Sonnet to assess its potential dangers. As reported by Sam Schechner in The Wall Street Journal, the team led by Logan Graham runs thousands of tests to check the AI’s capabilities in areas like … Read more
A recent iOS update has sparked debate about Apple’s artificial intelligence features and their privacy implications. Security journalist Spencer Ackerman, known for his work on the NSA documents with The Guardian, raised concerns about default settings in iOS 18.1 and Apple Intelligence’s data handling practices. While Ackerman worried about data being uploaded to cloud-based AI … Read more
A recent study by Lakera’s team demonstrates how GPT-4V can be manipulated through visual prompt injection attacks. As detailed by author Daniel Timbrell in his article, these attacks involve embedding text instructions within images to make AI models ignore their original programming or perform unintended actions. During Lakera’s internal hackathon, researchers successfully tested several methods, … Read more