Meta showcased its latest open AI hardware designs at the OCP Global Summit 2024. These include a new AI platform called “Catalina,” cutting-edge rack designs, and advanced network fabrics. According to Dan Rabinovitsj and Omar Baldonado in Meta’s “Engineering at Meta” blog, the company aims to foster collaboration and innovation.
Meta is significantly scaling its AI clusters to train large language models like Llama 3.1 405B, requiring over 16,000 NVIDIA H100 GPUs. They anticipate continued growth in compute needs for AI training.