NVIDIA GB200 NVL72
New Wave of Computing with NVIDIA GB200 NVL72
Introducing the cutting-edge NVIDIA GB200 compute tray, a revolutionary solution utilising the full potential of NVIDIA's innovative MGX design. With 2 powerful Grace CPUs and 4 advanced Blackwell GPUs, it delivers unparalleled performance to tackle the most demanding generative AI, data analytics and HPC tasks.
Computing Revolution with NVIDIA GB200 NVL72
Real-Time Inference for Trillion-Parameter LLMs
Experience unparalleled real-time LLM inference with the GB200 NVL72. Its cutting-edge second-generation Transformer Engine, FP4 AI and fifth-generation NVIDIA NVLink deliver a stunning 30x faster performance for trillion-parametre language models. This breakthrough is powered by a new generation of Tensor Cores, introducing advanced microscaling formats for superior accuracy and throughput. The GB200 NVL72 leverages NVLink and liquid cooling to create a massive 72-GPU rack to overcome communication bottlenecks
Massive LLM Training at High Speed
Accelerate massive-scale training with the GB200 NVL72's second-generation Transformer Engine featuring FP8 precision. A remarkable 4X faster training for LLM, redefining the boundaries of possibility. This groundbreaking performance is powered by fifth-generation NVLink, which connects up to 576 GPUs in a single NVLink domain with over 1 PB/s total bandwidth and 240 TB of fast memory. The GPU is als equipped with InfiBand networking for super speed and efficiency.
Benefits of NVIDIA Blackwell GB200
Groundbreaking Blackwell Architecture
The NVIDIA Blackwell architecture leads groundbreaking advancements for accelerated computing into a new era of unparalleled performance, efficiency and scalability. It packs 208 billion transistors and is manufactured using a custom-built TSMC 4NP process.
Sustainable Computing
Embrace a greener future with the liquid-cooled GB200 NVL72 racks. Reduce your carbon footprint and energy consumption while delivering 25X more performance than NVIDIA H100 air-cooled infrastructure at the same power.
Accelerated Data Processing
Experience high-bandwidth memory performance, NVLink-C2C, and dedicated decompression engines to accelerate key database queries by 18X compared to CPUs. Enjoy a 5X better TCO and revolutionise your data processing capabilities.
Breakthrough CPU Performance
The NVIDIA Grace CPU redefines modern Data Centre computing with outstanding performance and memory bandwidth. Experience 2X the energy efficiency of today's leading server processors while powering AI, cloud, and HPC applications with unprecedented speed.
Seamless Interconnectivity
Get the full potential of exascale computing and trillion-parametre AI models with the fifth-generation NVIDIA NVLink. This scale-up interconnect unleashes accelerated performance for swift and seamless communication between every GPU in your server cluster.
High-Performance Networking
NVIDIA Quantum-X800 InfiniBand, NVIDIA Spectrum X800 Ethernet, and NVIDIA BlueField®-3 DPUs enable efficient scalability across hundreds and thousands of Blackwell GPUs for optimal application performance.
Reserve your NVIDIA GB200 NVL72 today!
