NVIDIA GB200 NVL72

The NVIDIA GB200 NVL72 uses rack-scale liquid cooling to connect 36 Grace CPUs and 72 Blackwell GPUs. Its 72-GPU NVLink domain operates as a single large GPU, delivering 130TB/s ultra-low latency interconnects. Compared to the H100 platform, it accelerates real-time inference for trillion-parameter LLMs by 30x, LLM training by 4x, energy efficiency by 25x, and database query processing by 18x over CPUs. The GB200 Grace Blackwell superchip is the system's core building block, linking two Blackwell Tensor Core GPUs with one Grace CPU via NVLink-C2C.