MiniMax AI model has record-breaking 4 million token context
Singapore-based AI company MiniMax has launched a new open-source language model that can process up to 4 million tokens at once, doubling the previous record. According to Carl Franzen’s report in VentureBeat, the MiniMax-01 series includes both text and visual capabilities. The model uses an innovative “Lightning Attention” architecture and mixture of experts framework with … Read more