NVIDIA DGX GH200 Deep Learning Console

256x NVIDIA Grace Hopper Superchips

18,432 Arm® Neoverse V2 Cores

144TB GPU Memory

1 exaFLOPS Performance

Comprehensive Networking Suite

NVIDIA NVLink Switch System

Host baseboard management controller

Includes NVIDIA AI Enterprise, NVIDIA Base Command, and various OS options

Three-year standard support

Super power-efficient computing

Fully integrated and ready-to-run solution

 

We expect deliveries to retail customers in April 2024. Pricing available upon request. End-user agreement and usage terms required. For bulk inquiries, consult a live chat agent or call our toll-free number.

Categories: ,
  • img
  • img

    Giant Memory for Giant Models

    Unlike existing AI supercomputers that are designed to support workloads that fit within the memory of a single system, NVIDIA DGX GH200 is the only AI supercomputer that offers a shared memory space of up to 144TB across 256 Grace Hopper Superchips, providing developers with nearly 500X more fast-access memory to build massive models. DGX GH200 is the first supercomputer to pair Grace Hopper Superchips with the NVIDIA NVLink Switch System, which allows up to 256 GPUs to be united as one data-center-size GPU. This architecture provides 48X more bandwidth than the previous generation, delivering the power of a massive AI supercomputer with the simplicity of programming a single GPU.

  • img

    Super Power-Efficient Computing

    As the complexity of AI models has increased, the technology to develop and deploy them has become more resource intensive. However, using the NVIDIA Grace Hopper architecture, DGX GH200 achieves excellent power efficiency. Each NVIDIA Grace Hopper Superchip is both a CPU and GPU in one unit, connected with superfast NVIDIA NVLink-C2C. The Grace™ CPU uses LPDDR5X memory, which consumes one-eighth the power of traditional DDR5 system memory while providing 50 percent more bandwidth than eight-channel DDR5. And being on the same package, the Grace CPU and Hopper™ GPU interconnect consumes 5X less power and provides 7X the bandwidth compared to the latest PCIe technology used in other systems.

  • img

    Integrated and Ready to Run

    Designing, integrating, and operationalizing a hyperscale data center tuned for massive-memory application development can be complex and time consuming. With DGX GH200, NVIDIA is not just a technology provider but a trusted partner that helps ensure success. As a fully tested and integrated solution with software, compute, and networking, that includes white-glove services spanning installation and infrastructure management to expert advice on optimizing workloads, DGX GH200 lets teams hit the ground running.

Specification Details
CPU and GPU 256x NVIDIA Grace Hopper Superchips
CPU Cores 18,432 Arm® Neoverse V2 Cores with SVE2 4X 128b
GPU Memory 144TB
Performance 1 exaFLOPS
Networking 256x OSFP single-port NVIDIA ConnectX®-7 VPI with 400Gb/s InfiniBand, 256x dual-port NVIDIA BlueField®-3 VPI with 200Gb/s InfiniBand and Ethernet, 24x NVIDIA Quantum-2 QM9700 InfiniBand Switches, 20x NVIDIA Spectrum™ SN2201 Ethernet Switches, 22x NVIDIA Spectrum SN3700 Ethernet Switches
NVIDIA NVLink Switch System 96x L1 NVIDIA NVLink Switches, 36x L2 NVIDIA NVLink Switches
Management Network Host baseboard management controller (BMC) with RJ45
Software NVIDIA AI Enterprise (optimized AI software), NVIDIA Base Command (orchestration, scheduling, and cluster management), DGX OS / Ubuntu / Red Hat Enterprise Linux / Rocky (operating system)
Support Comes with three-year business-standard hardware and software support
Power Efficiency Uses NVIDIA Grace Hopper architecture for super power-efficient computing. Each NVIDIA Grace Hopper Superchip is both a CPU and GPU in one unit, connected with superfast NVIDIA NVLink-C2C. The Grace™ CPU uses LPDDR5X memory, which consumes one-eighth the power of traditional DDR5 system memory while providing 50 percent more bandwidth than eight-channel DDR5.
Integration Fully tested and integrated solution with software, compute, and networking, that includes white-glove services spanning installation and infrastructure management to expert advice on optimizing workloads.

Download

  • 02 Aug 2023 164 KB

Reviews

There are no reviews yet.

Only logged in customers who have purchased this product may leave a review.

You may also like…

  • Sale!

    NVIDIA A100 Enterprise PCIe 40GB/80GB

    $10,500.00$17,950.00
    Select options
  • Sale!

    NVIDIA H100 Enterprise PCIe-4 80GB

    $28,800.00$30,400.00
    Select options