AI tools that can generate realistic images are becoming a significant concern for research integrity specialists. The ease with which these tools can create fake scientific figures that are hard to distinguish from real ones raises fears of an increasingly untrustworthy scientific literature, Nature reports. Companies like Proofig and Imagetwin are developing AI-based solutions to …
Anthropic’s recently released Claude Computer Use feature allows Claude to control a computer by taking screenshots, running bash commands, and more. However, this also introduces severe prompt injection risks, as Claude could be exploited to run malicious code autonomously. A post on ”Embrace the Red” demonstrated this by the author crafting a malicious webpage that …
Character.AI, a platform backed by Google, allows users to create AI chatbots based on real people without their consent, raising ethical concerns. Megan Farokhmanesh reports in Wired about several instances where AI personas were created without the individuals’ knowledge or permission, including gaming journalist Alyssa Mercante and feminist media critic Anita Sarkeesian. Even a chatbot …
AI-powered tools make legal action cheaper and easier, as the case of the “LexPunk Army” shows. According to the Harvard Business Review, this group of lawyers and developers used an AI bot to submit masses of comments on a proposed law by the U.S. Treasury Department. The flood of 120,000 comments, compared to an average …
OpenAI’s recent report highlights the misuse of its platform by cyber actors aiming to influence global elections. The company has disrupted over 20 deceptive operations that utilized AI-generated content, including fake articles and social media posts, writes Hayden Field for CNBC. With significant elections approaching worldwide, including the U.S. presidential election, concerns about election-related misinformation …
Researchers at ETH Zurich have completely cracked Google’s reCAPTCHAv2 system. Using advanced machine learning methods, they solved 100% of the CAPTCHAs designed to distinguish humans from bots. Although the process still requires human intervention, fully automated CAPTCHA circumvention may soon become a reality. In response, companies like Google are developing more complex systems. However, this …
Generative AI is increasingly producing questionable scientific papers that can be found, for example, via Google Scholar. This is the result of an analysis by Swedish researchers. They found 139 papers with evidence of covert use of ChatGPT, especially on controversial topics such as the environment and health. Most of these papers appeared in non-indexed …
YouTube now allows users to request the removal of AI-generated content that simulates their face or voice. YouTube will review each request on a case-by-case basis, taking into account factors such as the content being flagged as synthetic, the unique identification of the person, and the potential value of the content.
According to Deloitte, the cost of deepfake fraud will rise to $40 billion by 2027, with banks and financial service providers particularly at risk. The technology is becoming more sophisticated and affordable, allowing attackers to create deepfake videos, voices and documents to defraud organizations. CEOs are particularly targeted in such attacks, which are often combined …
BNN Breaking, a news site with millions of readers, an international team of journalists, and a partnership with Microsoft, turned out to be a source of errors and misinformation. Former employees say the site relied heavily on AI-generated content, which was often published without sufficient verification. This led to complaints from people who were misidentified …