NVIDIA GB200 NVL72
New Wave of Computing with NVIDIA GB200 NVL72
Introducing the cutting-edge NVIDIA GB200 compute tray, a revolutionary solution utilising the full potential of NVIDIA's innovative MGX design. With 2 powerful Grace CPUs and 4 advanced Blackwell GPUs, it delivers unparalleled performance to tackle the most demanding generative AI, data analytics and HPC tasks.
Unrivalled Performance in...
LLM Training
1.7 TB fast memory for trillion-parameter LLMs
Multimodal Transformer Models
900 GB/s bandwidth accelerates multimodal transformer tasks
Generative 3D Capabilities
1.8 TB/s bidirectional throughput per GPU for generative models for 3D data
Data Processing
Experience faster data processing speed of up to 18x over typical CPUs
Computing Revolution with NVIDIA GB200 NVL72
Real-Time Inference for Trillion-Parameter LLMs
Experience unparalleled real-time LLM inference with the GB200 NVL72. Its cutting-edge second-generation Transformer Engine, FP4 AI and fifth-generation NVIDIA NVLink deliver a stunning 30x faster performance for trillion-parametre language models. This breakthrough is powered by a new generation of Tensor Cores, introducing advanced microscaling formats for superior accuracy and throughput. The GB200 NVL72 leverages NVLink and liquid cooling to create a massive 72-GPU rack to overcome communication bottlenecks
Massive LLM Training at High Speed
Accelerate massive-scale training with the GB200 NVL72's second-generation Transformer Engine featuring FP8 precision. A remarkable 4X faster training for LLM, redefining the boundaries of possibility. This groundbreaking performance is amplified by the fifth-generation NVLink, delivering an astonishing 1.8 terabytes per second (TB/s) of GPU-to-GPU interconnect and complemented by InfiniBand networking and NVIDIA Magnum IO software for unprecedented speed and efficiency
Benefits of NVIDIA GB200 NVL72
Groundbreaking Blackwell Architecture
The NVIDIA Blackwell architecture leads groundbreaking advancements for accelerated computing into a new era of unparalleled performance, efficiency and scalability. It packs 208 billion transistors and is manufactured using a custom-built TSMC 4NP process.
Sustainable Computing
Reduce carbon footprint and energy consumption with NVIDIA GB200 NVL72 racks. With advanced liquid cooling technology, these racks enable unprecedented compute density, minimising valuable floor space while facilitating high-bandwidth, low-latency GPU communication through large NVLink domain architectures.
Accelerated Data Processing
Experience high-bandwidth memory performance, NVLink-C2C, and dedicated decompression engines to accelerate key database queries by 18X compared to CPUs. Enjoy a 5X better TCO and revolutionise your data processing capabilities.
Breakthrough CPU Performance
The NVIDIA Grace CPU redefines modern Data Centre computing with outstanding performance and memory bandwidth. Experience 2X the energy efficiency of today's leading server processors while powering AI, cloud, and HPC applications with unprecedented speed.
Seamless Interconnectivity
Get the full potential of exascale computing and trillion-parametre AI models with the fifth-generation NVIDIA NVLink. This scale-up interconnect unleashes accelerated performance for swift and seamless communication between every GPU in your server cluster.
High-Performance Networking
NVIDIA Quantum-X800 InfiniBand, NVIDIA Spectrum X800 Ethernet, and NVIDIA BlueField®-3 DPUs enable efficient scalability across hundreds and thousands of Blackwell GPUs for optimal application performance.
Reserve your NVIDIA GB200 NVL72 today!
