China’s Kimi K3 rivals the world’s biggest AI models and it’s open source
Moonshot AI, the Beijing based startup backed by Alibaba, has released Kimi K3, a 2.8 trillion parameter model the company calls in an official blog post the world’s first open 3T-class model. The system combines two new architectural components, Kimi Delta Attention and Attention Residuals, with a 1 million token context window and native vision …