Opera now lets you download and run AI language models locally on your own computer – without an Internet connection, at no extra cost, and privately. There are over 150 models from more than 50 families to choose from, including Llama from Meta, Gemma from Google, and Vicuna. The feature is initially available to Opera … Read more
While commercial AI offerings have many guardrails and barriers to protect them from misuse, the open model Liberated-Qwen1.5-72B advertises that it has no such restrictions. Instead, it is specially trained to strictly follow the system prompt. This makes it harder to “jailbreak“. At the same time, you have to decide for yourself which answers and … Read more
RecurseChat brings AI chat to the Mac. Well-known alternatives are LM Studio and Jan, which are also available for Windows and Linux. They all offer an easier to understand user interface for self-installed language models.
NotesOllama is something for tech-savvy Mac users, but it shows what could be possible in the future. The tool integrates a locally installed chatbot directly into Apple Notes.
Stability AI is a provider of numerous AI tools that focuses more than others on open availability. There is now a large family of image generators that can be used on your own computer under the name Stable Diffusion. The recently announced Stable Diffusion 3 promises better quality in the future. This is especially true … Read more
Local AI is an interesting concept: AI assistants similar to ChatGPT that do not run in the cloud, but on your own PC or on a server you operate yourself. One challenge is the speed of the answers. Nvidia has now presented “Chat with RTX”, which uses the computing power of its own graphics cards. … Read more
While Google’s Gemini offerings are proprietary, the company has now unveiled two open source models under the name Gemma that are free to use. Officials say they are based on the same techniques used for Gemini. With 2 billion and 7 billion parameters, the two Gemma models are small and have limited capabilities. However, they … Read more
The creators of Stable Diffusion give a preview of Stable Cascade, which, thanks to its particular architecture, can be used on PCs without specialized and expensive hardware. Source: Stability.ai