Meta Platforms has released quantized versions of its Llama 3.2 1B and 3B models, which the company says offer reduced memory requirements, faster on-device inference, accuracy, and portability. The models were developed in close collaboration with Qualcomm and MediaTek and are available on SoCs with Arm CPUs. According to Meta, the average model size has …
Qualcomm has unveiled the Snapdragon 8 Elite, which the company claims is the world’s fastest mobile CPU. The chipset features Qualcomm’s second-generation Oryon CPU and is said to usher in a new era of on-device AI. As Dean Takahashi reports for VentureBeat, the processor enables complex multimodal AI applications directly on the smartphone, with a …
The AI image generation software ComfyUI has been released in version 1.0 and now offers a desktop version for Windows, MacOS and Linux. Background: ComfyUI allows you to implement complex image generation pipelines directly on your own computer. Unlike cloud-based solutions, the software provides full control over the process and your own data. The brand …
Nvidia has introduced a new AI model, Llama-3.1-Nemotron-70B-Instruct, which outperforms existing models from OpenAI and others, continuing a significant shift in its AI strategy. The model, available on Hugging Face, achieved impressive benchmark scores, positioning Nvidia as a competitive player in AI language understanding and generation. This development showcases Nvidia’s transition from a GPU manufacturer …
French AI company Mistral has introduced new generative AI models for laptops and smartphones. Known as “Les Ministraux,” the models are optimized for various applications such as text generation or collaboration with more powerful models. Kyle Wiggers reports for TechCrunch that two variants are available: Ministral 3B and Ministral 8B, both with a context window …
Researchers are apparently increasingly using small AI models on their own computers instead of the offerings of large AI services like ChatGPT. As Nature reports, freely available tools such as Llama or Phi-3 allow scientists to run AI models locally. This offers advantages: cost savings, data protection, and reproducibility. The local AI models are becoming …
Google wants to improve the accuracy of its AI models. To avoid “hallucinations,” the company is working with partners such as Moody’s, Thomson Reuters, and ZoomInfo who will feed the AI systems with up-to-date information. A new “confidence score” is also supposed to indicate how confident the AI is in its answer being correct. With …
Researchers are making great strides in developing 1-bit LLMs that can achieve similar performance to their larger counterparts while using significantly less memory and power. This development could open the door to more complex AI applications on everyday devices such as smartphones, as they require less processing power and energy.
The new $70 Raspberry Pi AI Kit allows users to implement AI applications for visual tasks with the microcomputer. The kit enables real-time object recognition, segmentation, and pose estimation with low power consumption, which could make the Raspberry Pi 5 suitable for many local AI applications.
Intel introduced the “Lunar Lake” processor, a completely redesigned laptop chip for AI applications that eliminates the need for separate memory modules and instead integrates up to 32GB of LPDDR5X memory directly into the chip package. Thanks to numerous optimizations, Intel promises up to 14 percent more CPU performance at the same clock speed, 50 …