Connects 36 Grace CPUs and 72 Blackwell GPUs in a rack-scale design, liquid-cooled, rack-scale solution that boasts a 72-GPU NVLink domain that acts as a massive GPU and delivers 30 times faster real-time trillion-parameter LLM inference.
2 Configurations (each Compute Tray Contains 4 GPUs):
The 36x2 Configuration
Here is the NVIDIA reference configuration for the 36x2 configuration:
-
MGX Rack
-
NVL36x2 GPU Racks
- 9x 2RU Compute trays.
- 9x 1RU NVL36 NVLink Switch trays.
- Cable cartridges and manifolds in the RU pitch.
Hybrid cooling trays:
- Grace CPU, Blackwell GPU, CX7, and NVLink Switch ASICs + OSFPs are liquid cooled.
- The rest of the components are air cooled.
The 72x1 Configuration
GB200 72x1 contains one rack with 72 GPUs.
-
Reference configuration:
- 18x 1RU Compute trays (4 GPUs per compute tray).
- 9x 1RU NVL72 NVLink Switch trays.
-
Hybrid cooling trays:
- Grace CPU, Blackwell GPU, CX7, and NVLink Switches ASICs are liquid cooled.
- Rest of the components are air cooled.
