The world's fastest server for AI research

• Up to 4 NVIDIA® A100 SXM4 GPUs (40 GB or 80 GB)
• NVLink and PCIe 4.0 GPU-to-GPU interconnect

2 AMD EPYC™ 7003 series CPUs. Options include:

• AMD EPYC 7313: 16 cores, 32 threads, 3.0 GHz base, 3.70 GHz boost, 128 MB cache
• AMD EPYC 7413: 24 cores, 48 threads, 2.65 GHz base, 3.60 GHz boost, 128 MB cache
• AMD EPYC 7513: 32 cores, 64 threads, 2.60 GHz base, 3.65 GHz boost, 128 MB cache
• AMD EPYC 7643: 48 cores, 96 threads, 2.30 GHz base, 3.60 GHz boost, 256 MB cache
• AMD EPYC 7663: 56 cores, 112 threads, 2.0 GHz base, 3.50 GHz boost, 256 MB cache
• AMD EPYC 7713: 64 cores, 128 threads, 2.0 GHz base, 3.675 GHz boost, 256 MB cache
• AMD EPYC 7763: 64 cores, 128 threads, 2.45 GHz base, 3.50 GHz boost, 256 MB cache

• Up to 4096 GB of 3200 MHz DDR4 ECC RAM in 32 DIMM slots
• 8 channels per processor

Up to 15.36 TB of storage via one 2.5" NVME SSD (PCIe 3.x or 4.0)

• Up to 46.08 TB of additional storage via 3 hot-swappable 2.5" NVMe SSDs (PCIe 3.x or 4.0)
• Designed to store large data sets and model checkpoints

Built-in networking:

• 2 RJ45 10 Gbps (aggregate) BASE-T LAN ports
• 1 RJ45 1 Gbps BASE-T LAN out-of-band management (IPMI) port

Up to 4 high-speed NICs for GPUDirect RDMA. Options include:

• 200 Gbps InfiniBand NVIDIA HDR ConnectX-6 VPI Adapter Card, 2x QSFP56, PCIe 4.0 x16
• 200 Gbps InfiniBand NVIDIA HDR ConnectX-6 VPI Adapter Card, 1x QSFP56, PCIe 4.0 x16
• 100 Gbps InfiniBand NVIDIA HDR100 ConnectX-6 VPI Adapter Card, 1x QSFP56, PCIe 4.0 x16
• 100 Gbps InfiniBand NVIDIA HDR100 ConnectX-6 VPI Adapter Card, 2x QSFP56, PCIe 4.0 x16
• 200 Gbps Ethernet NVIDIA ConnectX-6 EN Adapter Card, 2x QSFP56, PCIe 4.0 x16
• 200 Gbps Ethernet NVIDIA ConnectX-6 Dx EN Adapter Card, 1x QSFP56, PCIe 4.0 x16
• 100 Gbps Ethernet NVIDIA ConnectX-6 EN Adapter Card, 2x QSFP56, PCIe 4.0 x16
• 100 Gbps Ethernet NVIDIA ConnectX-6 Dx EN Adapter Card, 1x QSFP56, PCIe 4.0 x16

• Two 2200 watt 80 PLUS™ Platinum PSUs
• 2 + 0 redundancy

AC input:

• 220-240Vac / 11-10 amperes / 50-60 Hz

Max output per PSU:

• 220-240 Vac: 2200 watts

• Power button
• Reset button
• Power LED
• Information LED
• Power supply failure LED
• 2 LAN activity LEDs, one for each RJ45 10 Gbps (aggregate) BASE-T LAN port
• Storage drive activity LED

• UID button with LED
• VGA port
• 2 USB 3.0 ports
• 2 RJ45 10 Gbps (aggregate) BASE-T LAN ports
• 1 RJ45 1 Gbps BASE-T LAN out-of-band management (IPMI) port

• Rackmounting kit
• 4 configurable power cables

• Form factor: 2U rackmount
• Width: 17.2 inches (437 mm)
• Height: 3.5 inches (89 mm)
• Depth: 32.7 inches (830.3 mm)
• Server weight: 78.5 lbs (35.6 kg)
• Rackmounting kit weight: 5 lbs (2.3 kg)
• Total weight with packaging: 88.5 lbs (40.1 kg)

• 8 NVIDIA® A100 SXM4 GPUs (40 GB or 80 GB)
• NVLINK™ and NVIDIA® NVSwitch™ fabric

2 AMD EPYC™ 7003 series CPUs. Options include:

• AMD EPYC 7313: 16 cores, 32 threads, 3.0 GHz base, 3.70 GHz boost, 128 MB cache, PCIe 4.0
• AMD EPYC 7413: 24 cores, 48 threads, 2.65 GHz base, 3.60 GHz boost, 128 MB cache, PCIe 4.0
• AMD EPYC 7513: 32 cores, 64 threads, 2.60 GHz base, 3.65 GHz boost, 128 MB cache, PCIe 4.0
• AMD EPYC 7643: 48 cores, 96 threads, 2.30 GHz base, 3.60 GHz boost, 256 MB cache, PCIe 4.0
• AMD EPYC 7663: 56 cores, 112 threads, 2.0 GHz base, 3.50 GHz boost, 256 MB cache, PCIe 4.0
• AMD EPYC 7713: 64 cores, 128 threads, 2.0 GHz base, 3.675 GHz boost, 256 MB cache, PCIe 4.0
• AMD EPYC 7763: 64 cores, 128 threads, 2.45 GHz base, 3.50 GHz boost, 256 MB cache, PCIe 4.0

• Up to 4096 GB of 3200 MHz DDR4 ECC RAM in 32 DIMM slots
• 8 channels per processor

Up to 15.36 TB of storage via one 2.5" NVME SSD (PCIe 3.x or PCIe 4.0)

• Up to 138.24 TB of additional storage via 9 NVMe SSDs (PCIe 3.x or 4.0)
• Designed to store large data sets and model checkpoints

Built-in networking:

• 2 RJ45 10 Gbps BASE-T LAN ports
• 1 RJ45 1 Gbps BASE-T LAN out-of-band management (IPMI) port

Up to 8 high-speed NICs for GPUDirect RDMA. Options include:

• 200 Gbps InfiniBand NVIDIA HDR ConnectX-6 VPI Adapter Card, 2x QSFP56, PCIe 4.0 x16
• 200 Gbps InfiniBand NVIDIA HDR ConnectX-6 VPI Adapter Card, 1x QSFP56, PCIe 4.0 x16
• 100 Gbps InfiniBand NVIDIA HDR100 ConnectX-6 VPI Adapter Card, 1x QSFP56, PCIe 4.0 x16
• 100 Gbps InfiniBand NVIDIA HDR100 ConnectX-6 VPI Adapter Card, 2x QSFP56, PCIe 4.0 x16
• 200 Gbps Ethernet NVIDIA ConnectX-6 EN Adapter Card, 2x QSFP56, PCIe 4.0 x16
• 200 Gbps Ethernet NVIDIA ConnectX-6 Dx EN Adapter Card, 1x QSFP56, PCIe 4.0 x16
• 100 Gbps Ethernet NVIDIA ConnectX-6 EN Adapter Card, 2x QSFP56, PCIe 4.0 x16
• 100 Gbps Ethernet NVIDIA ConnectX-6 Dx EN Adapter Card, 1x QSFP56, PCIe 4.0 x16

• 4 hot-swappable 3000 watt 80 PLUS™ Titanium PSUs
• 2 + 2 redundancy

AC input:

• 200-207 Vac / 16-15.7 amperes / 50-60 Hz
• 207.1-240 Vac / 16-14.5 amperes / 50-60 Hz

Max output per PSU:

• 200-207 Vac: 2880 watts
• 207.1–240 Vac: 3000 watts

• Power button
• Reset button
• Power LED
• UID button with LED
• Information LED
• 1 RJ45 1 Gbps BASE-T LAN out-of-band management (IPMI) port
• LAN activity LED for out-of-band management (IPMI) port

2 RJ45 10 Gbps BASE-T LAN ports

• Rackmounting kit
• 4 C19 TO C20 power cables (4 foot)

• Form factor: 4U rackmount
• Width: 17.6 inches (446 mm)
• Height: 6.9 inches (174 mm)
• Depth: 35.4 inches (900 mm)
• Server weight: 166 lbs (75.3 kg)
• Rackmounting kit weight: 5 lbs (2.3 kg)
• Total weight with packaging: 225 lbs (102.1 kg)