Reports of hundreds of AI agents coordinating during a security evaluation are intensifying concerns about how autonomous systems behave when they pursue goals without direct human oversight. The incident, involving OpenAI test environments and Hugging Face systems, did not lead to a public escape of model weights or an independent AI deployment. But the accounts …
OpenAI says it has slowed some work on its upcoming model Astra after internal testing suggested it may have reached a new level of cybersecurity capability. The company says it “cannot rule out” that Astra meets its Critical threshold under its Preparedness Framework, its highest risk category for cyber capabilities. Under that framework, a model …
OpenAI chief executive Sam Altman is set to meet senior Trump administration officials, senators and economists in Washington this week as policymakers debate AI security and access to Chinese models. Ashley Capoot and Kate Rooney report for CNBC that Altman plans to preview OpenAI’s upcoming model family and answer questions about cybersecurity, AI agents and …
A new survey by device management company Jamf finds that companies using artificial intelligence extensively are significantly more likely to experience security incidents tied to that use. The survey polled 687 IT professionals and highlights a growing gap between how fast organizations adopt AI and how well they can govern it. Nearly three quarters of …
The US government has ordered Anthropic to restrict access to its two most advanced AI models, Fable 5 and Mythos 5, to US citizens only. Anthropic, unable to verify the citizenship of its users, responded by taking both models offline entirely. The move marks the first time the US government has issued an export control …
OpenAI is rolling out a new optional security feature called Lockdown Mode, designed to protect users from prompt injection attacks. Igor Bonifacic reports for Engadget that the feature is aimed at people and organisations handling sensitive data. Prompt injection is a form of social engineering targeting AI chatbots. Attackers hide malicious instructions on webpages or …
Anthropic’s newest and most capable AI model, Claude Mythos, can autonomously find and exploit security vulnerabilities in virtually all major software systems. As I wrote previously, Mythos is currently only available to a select group of technology companies through Project Glasswing, Anthropic’s initiative to patch critical software before the capabilities become more widely known. Zvi …
Anthropic has introduced a new AI model it considers too dangerous to release publicly. The model, called Claude Mythos Preview, can autonomously find and exploit security vulnerabilities in software. Instead of making it widely available, Anthropic is sharing access with a coalition of more than 40 organizations as part of an initiative called Project Glasswing. …
OpenAI has removed the word “safely” from its mission statement, a change documented in its 2024 tax filing with the Internal Revenue Service. The deletion coincides with the company’s transformation from a nonprofit organization into a for-profit business. The original mission statement from 2022 and 2023 read: “to build general-purpose artificial intelligence (AI) that safely …
Anthropic has emerged as a formidable competitor in the artificial intelligence industry by focusing on enterprise customers and positioning itself as the most safety-conscious AI company. The approach appears to be paying off both commercially and in investor confidence, even as critics question whether the company can maintain its principles while racing to capture market …