NVIDIA and xAI have collaborated to build the world's largest AI supercomputer, Colossus. This massive cluster features 100,000 NVIDIA Hopper Tensor Core GPUs and utilizes NVIDIA's Spectrum-X Ethernet networking for superior AI model training performance. The deployment of Colossus has achieved exceptional network performance, with 95% data throughput without application latency degradation or packet loss.

Source: https://Blockchain.News/news/nvidia-powers-worlds-largest-ai-supercomputer-spectrum-x-networking