Perplexica is an open source AI search engine

Perplexica is an open source search engine with AI support, similar to Perplexity. It provides answers with references. Once installed, it can use local language models such as Llama 3 or Mixtral.

Zyphra Zamba brings AI to more devices

Zyphra introduces Zamba, an open source 7 billion parameter model designed to bring artificial intelligence to more devices, with a decentralized approach and smaller model size to provide a more cost-effective and personalized alternative to large, centralized AI models.

Intel’s new chips supposed to deliver better AI performance

Intel confirms that Microsoft’s Copilot AI assistant will soon run locally on PCs powered by its chips. Intel’s Lunar Lake processors, due out at the end of the year, are expected to deliver three times the AI performance of current Meteor Lake chips, meeting the needs of the next generation of AI PCs.

Databricks DBRX is an on-premise ChatGPT alternative

Databricks introduces DBRX, a new open source AI model designed to provide enterprises with a cost-effective and efficient alternative to GPT-3.5. Because companies deploy and manage it themselves, the security and confidentiality of data is better protected than with an external offering such as ChatGPT. Source: VentureBeat

Opera: Text AI on your own PC

Opera now lets you download and run AI language models locally on your own computer – without an Internet connection, at no extra cost, and privately. There are over 150 models from more than 50 families to choose from, including Llama from Meta, Gemma from Google, and Vicuna. The feature is initially available to Opera …

Read more

This new AI model is particularly obedient

While commercial AI offerings have many guardrails and barriers to protect them from misuse, the open model Liberated-Qwen1.5-72B advertises that it has no such restrictions. Instead, it is specially trained to strictly follow the system prompt. This makes it harder to “jailbreak“. At the same time, you have to decide for yourself which answers and …

Read more

RecurseChat brings local AI to your Mac

RecurseChat brings AI chat to the Mac. Well-known alternatives are LM Studio and Jan, which are also available for Windows and Linux. They all offer an easier to understand user interface for self-installed language models.

Notes Ollama brings a local chatbot to your notes

NotesOllama is something for tech-savvy Mac users, but it shows what could be possible in the future. The tool integrates a locally installed chatbot directly into Apple Notes.

Stable Diffusion 3 image generator announced

Stability AI is a provider of numerous AI tools that focuses more than others on open availability. There is now a large family of image generators that can be used on your own computer under the name Stable Diffusion. The recently announced Stable Diffusion 3 promises better quality in the future. This is especially true …

Read more

Nvidia Chat with RTX: Local AI

Local AI is an interesting concept: AI assistants similar to ChatGPT that do not run in the cloud, but on your own PC or on a server you operate yourself. One challenge is the speed of the answers. Nvidia has now presented “Chat with RTX”, which uses the computing power of its own graphics cards. …

Read more