Nvidia introduces NIM (Nvidia Inference Microservices), a new technology that supposedly enables developers to deliver AI applications in minutes instead of weeks. These microservices provide optimized models as containers that can be deployed in clouds, data centers, or on workstations. The goal is to enable organizations to build generative AI applications for co-piloting, chatbots, and …
IT service provider Kyndryl and Nvidia are working together to make it easier for businesses to use generative AI. The partnership combines Nvidia’s hardware and software with Kyndryl’s expertise in implementing and scaling AI projects.
Nvidia’s ChatRTX chatbot now supports Google’s Gemma model, allowing users to interact with their own documents, photos, and YouTube videos. The update also includes voice search and offers more ways to search locally stored data using different AI models.
Local AI is an interesting concept: AI assistants similar to ChatGPT that do not run in the cloud, but on your own PC or on a server you operate yourself. One challenge is the speed of the answers. Nvidia has now presented “Chat with RTX”, which uses the computing power of its own graphics cards. …