Researchers are making great strides in developing 1-bit LLMs that can achieve similar performance to their larger counterparts while using significantly less memory and power. This development could open the door to more complex AI applications on everyday devices such as smartphones, as they require less processing power and energy.
The new $70 Raspberry Pi AI Kit allows users to implement AI applications for visual tasks with the microcomputer. The kit enables real-time object recognition, segmentation, and pose estimation with low power consumption, which could make the Raspberry Pi 5 suitable for many local AI applications.
Intel introduced the “Lunar Lake” processor, a completely redesigned laptop chip for AI applications that eliminates the need for separate memory modules and instead integrates up to 32GB of LPDDR5X memory directly into the chip package. Thanks to numerous optimizations, Intel promises up to 14 percent more CPU performance at the same clock speed, 50 …
Jolla, known for its Sailfish operating system, presents a new approach to AI assistants with Jolla Mind2. This personal server, which will be available in the fall for 699 Euros (plus monthly subscription fees), is designed to perform AI-based tasks without sending data to the cloud.
Perplexica is an open source search engine with AI support, similar to Perplexity. It provides answers with references. Once installed, it can use local language models such as Llama 3 or Mixtral.
Zyphra introduces Zamba, an open source 7 billion parameter model designed to bring artificial intelligence to more devices, with a decentralized approach and smaller model size to provide a more cost-effective and personalized alternative to large, centralized AI models.
Intel confirms that Microsoft’s Copilot AI assistant will soon run locally on PCs powered by its chips. Intel’s Lunar Lake processors, due out at the end of the year, are expected to deliver three times the AI performance of current Meteor Lake chips, meeting the needs of the next generation of AI PCs.
Databricks introduces DBRX, a new open source AI model designed to provide enterprises with a cost-effective and efficient alternative to GPT-3.5. Because companies deploy and manage it themselves, the security and confidentiality of data is better protected than with an external offering such as ChatGPT. Source: VentureBeat
Opera now lets you download and run AI language models locally on your own computer – without an Internet connection, at no extra cost, and privately. There are over 150 models from more than 50 families to choose from, including Llama from Meta, Gemma from Google, and Vicuna. The feature is initially available to Opera …
While commercial AI offerings have many guardrails and barriers to protect them from misuse, the open model Liberated-Qwen1.5-72B advertises that it has no such restrictions. Instead, it is specially trained to strictly follow the system prompt. This makes it harder to “jailbreak“. At the same time, you have to decide for yourself which answers and …