GPU server built for deep learning

Up to 8 GPUs. Options include:

• NVIDIA® A40: 48 GB of GDDR6, 10,752 CUDA cores, 336 Tensor Cores, PCIe 4.0 x16, passive cooling
• NVIDIA® A30: 24 GB of GDDR6, 3,584 CUDA cores, 224 Tensor Cores, PCIe 4.0 x16, passive cooling
• NVIDIA® RTX A6000: 48 GB of GDDR6, 10,752 CUDA cores, 336 Tensor Cores, PCIe 4.0 x16
• NVIDIA® RTX A5000: 24 GB of GDDR6, 8,192 CUDA cores, 256 Tensor Cores, PCIe 4.0 x16
• NVIDIA® RTX A4500: 20 GB of GDDR6, 7,168 CUDA cores, 224 Tensor Cores, PCIe 4.0 x16

2 AMD EPYC™ 7003 series CPUs. Options include:

• AMD EPYC 7313: 16 cores, 32 threads, 3.0 GHz base, 3.70 GHz boost, 128 MB cache
• AMD EPYC 7413: 24 cores, 48 threads, 2.65 GHz base, 3.60 GHz boost, 128 MB cache
• AMD EPYC 7513: 32 cores, 64 threads, 2.60 GHz base, 3.65 GHz boost, 128 MB cache
• AMD EPYC 7643: 48 cores, 96 threads, 2.30 GHz base, 3.60 GHz boost, 256 MB cache
• AMD EPYC 7663: 56 cores, 112 threads, 2.0 GHz base, 3.50 GHz boost, 256 MB cache
• AMD EPYC 7713: 64 cores, 128 threads, 2.0 GHz base, 3.675 GHz boost, 256 MB cache
• AMD EPYC 7763: 64 cores, 128 threads, 2.45 GHz base, 3.50 GHz boost, 256 MB cache

• Up to 2048 GB of 3200 MHz DDR4 ECC RAM in 16 DIMM slots
• 8 memory channels per processor

Up to 15.36 TB of storage via one 2.5" NVME SSD (PCIe 3.x)

• Up to 46.08 TB of extra storage via 3 hot-swappable 2.5" NVMe SSDs (PCIe 3.x)
• Designed to store large data sets and model checkpoints

Built-in networking:

• 2 RJ45 10 Gbps BASE-T LAN ports
• 1 RJ45 10/100/1000 Mbps BASE-T LAN out-of-band management port

Up to 2 high-speed NICs. Options include:

• 200 Gbps InfiniBand NVIDIA HDR ConnectX-6 VPI Adapter Card, 2x QSFP56, PCIe 4.0 x16
• 200 Gbps InfiniBand NVIDIA HDR ConnectX-6 VPI Adapter Card, 1x QSFP56, PCIe 4.0 x16
• 100 Gbps InfiniBand NVIDIA HDR100 ConnectX-6 VPI Adapter Card, 1x QSFP56, PCIe 4.0 x16
• 100 Gbps InfiniBand NVIDIA HDR100 ConnectX-6 VPI Adapter Card, 2x QSFP56, PCIe 4.0 x16
• 200 Gbps Ethernet NVIDIA ConnectX-6 EN Adapter Card, 2x QSFP56, PCIe 4.0 x16
• 200 Gbps Ethernet NVIDIA ConnectX-6 Dx EN Adapter Card, 1x QSFP56, PCIe 4.0 x16
• 100 Gbps Ethernet NVIDIA ConnectX-6 EN Adapter Card, 2x QSFP56, PCIe 4.0 x16
• 100 Gbps Ethernet NVIDIA ConnectX-6 Dx EN Adapter Card, 1x QSFP56, PCIe 4.0 x16

• Two 2200 watt 80 PLUS™ Platinum power supplies
• 2 + 0 redundancy

AC input:

• 200-240 Vac / 12.6 amperes / 47-63 Hz

Max output per PSU:

• 200-240V Vac: 2200 watts

• Power button with LED
• Reset button
• UID button with LED
• System status LED
• 2 LAN activity LEDs, one for each RJ45 10 Gbps BASE-T LAN port
• Storage drive activity LED

• VGA port
• 2 USB 3.0 ports
• Power button with LED
• Reset button
• UID button with LED
• NMI button
• System status LED

• Rackmounting kit
• 2 C19 to C20, 15AWG, 250V/15A, 6 foot power cables

• Form factor: 2U rackmount
• Width: 17.64 inches (448 mm)
• Height: 3.4 inches (87.5 mm)
• Depth: 31.5 inches (800 mm)
• Server weight: 73 lbs (33 kg)
• Rackmounting kit weight: 5 lbs (2.3 kg)
• Total weight with packaging: 99 lbs (45 kg)

Up to 8 GPUs. Options include:

• NVIDIA® A100: 80 GB of HBM2e, 6,912 CUDA cores, 432 Tensor Cores, PCIe 4.0 x16, passive cooling
• NVIDIA® A40: 48 GB of GDDR6, 10,752 CUDA cores, 336 Tensor Cores, PCIe 4.0 x16, passive cooling
• NVIDIA® A30: 24 GB of GDDR6, 3,584 CUDA cores, 224 Tensor Cores, PCIe 4.0 x16, passive cooling
• NVIDIA® RTX A6000: 48 GB of GDDR6, 10,752 CUDA cores, 336 Tensor Cores, PCIe 4.0 x16
• NVIDIA® RTX A5000: 24 GB of GDDR6, 8,192 CUDA cores, 256 Tensor Cores, PCIe 4.0 x16
• NVIDIA® RTX A4500: 20 GB of GDDR6, 7,168 CUDA cores, 224 Tensor Cores, PCIe 4.0 x16
• NVIDIA® RTX A4000: 16 GB of GDDR6, 6,144 CUDA cores, 192 Tensor Cores, PCIe 4.0 x16

2 AMD EPYC™ 7003 series CPUs. Options include:

• AMD EPYC 7313: 16 cores, 32 threads, 3.0 GHz base, 3.70 GHz boost, 128 MB cache, PCIe 4.0
• AMD EPYC 7413: 24 cores, 48 threads, 2.65 GHz base, 3.60 GHz boost, 128 MB cache, PCIe 4.0
• AMD EPYC 7513: 32 cores, 64 threads, 2.60 GHz base, 3.65 GHz boost, 128 MB cache, PCIe 4.0
• AMD EPYC 7643: 48 cores, 96 threads, 2.30 GHz base, 3.60 GHz boost, 256 MB cache, PCIe 4.0
• AMD EPYC 7663: 56 cores, 112 threads, 2.0 GHz base, 3.50 GHz boost, 256 MB cache, PCIe 4.0
• AMD EPYC 7713: 64 cores, 128 threads, 2.0 GHz base, 3.675 GHz boost, 256 MB cache, PCIe 4.0
• AMD EPYC 7763: 64 cores, 128 threads, 2.45 GHz base, 3.50 GHz boost, 256 MB cache, PCIe 4.0

• Up to 4096 GB of 3200 MHz DDR4 ECC RAM in 32 DIMM slots
• 8 channels per processor

Up to 15.36 TB of storage via one 2.5" NVME SSD (PCIe 3.x or PCIe 4.0)

• Up to 46.08 TB of additional storage via 3 hot-swappable 2.5" NVMe SSDs (PCIe 3.x or 4.0)
• Designed to store large data sets and model checkpoints

Built-in networking:

• 2 RJ45 1 Gbps BASE-T LAN ports
• 1 RJ45 10/100/1000 Mbps BASE-T LAN out-of-band management port

Optional high-speed NIC. Options include:

• 200 Gbps InfiniBand NVIDIA HDR ConnectX-6 VPI Adapter Card, 2x QSFP56, PCIe 4.0 x16
• 200 Gbps InfiniBand NVIDIA HDR ConnectX-6 VPI Adapter Card, 1x QSFP56, PCIe 4.0 x16
• 100 Gbps InfiniBand NVIDIA HDR100 ConnectX-6 VPI Adapter Card, 1x QSFP56, PCIe 4.0 x16
• 100 Gbps InfiniBand NVIDIA HDR100 ConnectX-6 VPI Adapter Card, 2x QSFP56, PCIe 4.0 x16
• 200 Gbps Ethernet NVIDIA ConnectX-6 EN Adapter Card, 2x QSFP56, PCIe 4.0 x16
• 200 Gbps Ethernet NVIDIA ConnectX-6 Dx EN Adapter Card, 1x QSFP56, PCIe 4.0 x16
• 100 Gbps Ethernet NVIDIA ConnectX-6 EN Adapter Card, 2x QSFP56, PCIe 4.0 x16
• 100 Gbps Ethernet NVIDIA ConnectX-6 Dx EN Adapter Card, 1x QSFP56, PCIe 4.0 x16

• 4 hot-swappable 2000 watt 80 PLUS™ Titanium power supplies
• 2 + 2 redundancy

AC input:

• 100-127 Vac / 12-9.0 amperes / 50-60 Hz
• 200-220 Vac / 10-9.8 amperes / 50-60 Hz
• 220-230 Vac / 10-9.8 amperes / 50-60 Hz
• 230-240 Vac / 10-9.8 amperes / 50-60 Hz

Max output per PSU:

• 100–127 Vac: 1000 watts
• 200–220 Vac: 1800 watts
• 220–230 Vac: 1980 watts
• 230–240 Vac: 2000 watts

• Power button
• Reset button
• Power LED
• ID button with LED
• Information LED
• Power supply failure LED
• 2 LAN activity LEDs, one for each RJ45 1 Gbps BASE-T LAN port
• Storage drive activity LED

• VGA port
• 2 USB 3.0 ports
• 2 RJ45 10 Gbps BASE-T LAN ports
• 1 RJ45 10/100/1000 Mbps BASE-T LAN out-of-band management port

• Form factor: 4U rackmount
• Width: 17.2 inches (437 mm)
• Height: 7.0 inches (179 mm)
• Depth: 29.0 inches (737 mm)
• Server weight: 73 lbs (33 kg)
• Rackmounting kit weight: 5 lbs (2.3 kg)
• Total weight with packaging: 99 lbs (45 kg)