Hugging Face LightEval helps evaluate LLMs

Hugging Face has introduced LightEval, a new open source solution for evaluating large language models (LLMs). This was reported by Michael Nuñez on VentureBeat. The lightweight suite allows companies and researchers to evaluate AI models in a precise and customizable way. LightEval integrates seamlessly with existing Hugging Face tools and supports multiple devices including CPUs, …

Read more

Apple Intelligence beta coming in October

Apple will release the beta version of Apple Intelligence with iOS 18.1 in October. The first features will be available in US English only, the company announced. Other English versions will follow in December for users in Australia, Canada and the UK. Chinese, French, Japanese and Spanish are planned for 2025. Apple Intelligence is offered …

Read more

Doubts about Reflection 70B performance

What a difference a weekend makes: Just a few days ago, the new Reflection 70B was considered the potential champion among open source models. According to official information, the model is based on Meta’s Llama 3.1 70B, but with a special feature: it is specially trained not to give an immediate answer, but to analyze …

Read more

AI startups have little chance against tech giants

Large technology companies are investing billions in the development of artificial intelligence. As Bloomberg reports, even AI startups with hundreds of millions of dollars in funding can barely keep up. Companies like Meta, Google, and Microsoft, as well as a few startups like OpenAI, are spending huge sums on computing power, training data, and talent. …

Read more

How trustworthy is Chatbot Arena?

Chatbot Arena, a benchmarking tool for AI models, has become very popular in the tech industry. As Kyle Wiggers reports on TechCrunch, companies like OpenAI and Google use the platform to test the performance of their chatbots. Millions of people visited the LMSYS website last year. However, experts are critical of the validity of the …

Read more

Why OpenAI’s Sora is still not available

OpenAI is apparently delaying the release of its much-anticipated AI video model Sora. The company is currently in talks with policymakers and looking for partnerships in the entertainment industry. According to a statement to CNBC, Sora is still in the research phase. OpenAI CTO Mira Murati announced that Sora will be released this year, but …

Read more

Getty Images releases dataset for AI training

Getty Images has released a high quality image dataset for AI training on Hugging Face. The dataset includes 3,750 images from 15 categories and is characterized by commercial security and high quality, Andrea Gagliano, head of data science and AI/ML at Getty Images, tells VentureBeat. The images are curated specifically for machine learning, in high …

Read more

Google Prompt Poet helps with complex prompts

Google has introduced Prompt Poet, an innovative tool for advanced prompt engineering. As Michael Trestman reports for VentureBeat, the system developed by Character.ai simplifies the creation of complex prompts for large language models through a user-friendly template system. Prompt Poet seamlessly integrates external data to enable contextual AI responses. The special feature of Prompt Poet …

Read more

Replit Agent helps to code complete applications

Replit has introduced an AI agent that can build complete applications from scratch. As Chris McKay reports in an article for Maginative, this is much more than just a coding assistant. The agent can develop software on its own, from project planning and code writing to debugging and deployment. According to Replit CEO Amjad Masad, …

Read more

Infinity creates talking characters

A new AI model called Infinity generates realistic talking characters. It is based on a video diffusion transformer that has been trained with audio input. According to the developers, this is the first model of its kind. Users can enter their scripts and get videos of animated characters speaking the text. It can process different …

Read more

×