Apple’s new iPhone notification feature is under scrutiny after generating misleading news headlines, according to a BBC report by Graham Fraser. The BBC has filed a complaint with Apple after the AI-powered summary feature incorrectly suggested that murder suspect Luigi Mangione had shot himself. The incident involves Apple Intelligence, that uses AI to summarize and … Read more
Microsoft’s new Recall feature, designed to create searchable timeline of PC activities, shows significant privacy vulnerabilities despite its promised security measures. According to testing by Avram Piltch from Tom’s Hardware, the feature’s “Filter sensitive information” setting failed to block the capture of credit card numbers and social security information in several common scenarios. While Recall … Read more
A local Hawaiian newspaper, The Garden Island, discontinued its AI-generated news broadcast program after a two-month trial period, reports Guthrie Scrimgeour. The program, which featured AI presenters James and Rose created by Israeli firm Caledo, was the first of its kind in the United States. The virtual anchors struggled with pronunciation, displayed unnatural behavior, and … Read more
Researchers have discovered that Whisper, an AI-powered transcription tool used in various industries including healthcare, is prone to making up text or entire sentences, known as hallucinations. According to interviews with software engineers, developers, and academic researchers by AP, these hallucinations can include problematic content such as racial commentary, violent rhetoric, and imagined medical treatments. … Read more
Google’s NotebookLM can be fooled by manipulated websites. Developer Ted Benson demonstrated this by presenting his website to Google’s AI crawler with a made-up story about a trip to the moon with a bicycle, balloons, and scuba gear, while human visitors saw the regular page. He warns that this method of feeding LLMs with targeted … Read more
Figma has temporarily withdrawn its new AI tool “Make Designs” after it created designs for a weather app that were strikingly similar to Apple’s version. This raises the question of whether the models from OpenAI and Amazon used by Figma were trained on Apple’s designs. Figma has taken responsibility for the incident and intends to … Read more
In a previous Smart Content Report, I featured a funny illustrated guide generated by ChatGPT’s Dall-E: I find such “failures” interesting to see, because they can reveal fundamental problems. For example, we are still a long way from an AI that actually understands the world around it (“General World Model”). At the moment, these tools … Read more
A new benchmark test from Sierra shows that even advanced language models such as GPT-4o still struggle with more complicated tasks in everyday scenarios, achieving a success rate of less than 50 percent. The test, called TAU-bench, is designed to help developers evaluate the performance of AI agents in realistic situations, taking into account factors … Read more
The recently introduced “AI Overviews” in Google Search have produced some strange results – some embarrassing, some ridiculous, some dangerous. This can be seen as an example for what various experts already know and preach: Don’t let your AI work unsupervised. For example, one of Google AI’s recommendations was that cheese sticks better to pizza … Read more
AI image generators often fail because they don’t understand (yet?) what they’re creating. Mirrors are a good example. Source: Reddit