Today, most AI applications run in the cloud on powerful, specialized computers in data centers. But experts say this will not always be the case. There will also be an increasing number of small models that run directly on users’ devices, from PCs to smartphones. This is called edge AI, after the concept of edge …
Some AI applications are freely available. Examples include language models from French vendor Mistral or the Llama family from Facebook/Meta. However, it is not correct to call these “open source”. What you get as a user is the end result of the training, the core of a large language model called “weights”. At the same …
Commercial AIs like ChatGPT or Claude have a mostly invisible system prompt that explains important rules and guidelines to the assistant. The system prompt therefore influences how an AI behaves and whether it refuses certain requests, for example. A member of the Claude team recently published their assistant’s system prompt on Twitter/X, explaining it line …
Merging, in the context of generative AI, refers to the combination or fusion of different AI models or their characteristics. Similar to creating a collage, the best or desired features of multiple models are united into a new model. A practical example is the merging of different Stable Diffusion models, where one model’s ability to …
Multimodal (from Latin: multi = many, multiple and modus = way, manner) refers, in the context of Artificial Intelligence, to an AI system’s ability to process and understand different types of input or “modalities” simultaneously. While earlier AI systems typically focused on a single form of communication – such as text or images – multimodal …
Temperature in Large Language Models (LLMs) and other generative AI systems is a crucial control parameter that influences the randomness and creativity of the outputs. The value typically ranges from 0 to 1, where 0 represents highly deterministic (predictable) and 1 represents very random responses. With a low temperature setting, the system consistently repeats the …
Fine tuning refers to the subsequent optimization of a pre-trained AI model for a specific task or vocabulary. For the original training of these models, large amounts of data from the Internet were first processed to gain a general understanding. Fine tuning then adapts this general knowledge to a specific use case. For example, an …
RAG (Retrieval-Augmented Generation) is a technique where AI language models are enhanced with additional, external sources of information. In this process, the AI system’s responses are not only generated from its original training but are also supplemented (augmented) with specifically retrieved current or specialized data. It can be compared to an expert who doesn’t just …