New! Cloud GPU servers from $1.25/hour

GPU server built for deep learning

Up to ten customizable GPUs with AMD EPYC or Intel Xeon processor. Pre-installed with Ubuntu, TensorFlow, PyTorch, CUDA, and cuDNN.

Start your build
Lambda Scalar server with 4x NVIDIA GPUs

5000+ research groups trust Lambda

Easy system administration

Our GPU servers comes with Lambda Stack, which includes frameworks like TensorFlow and PyTorch. Lambda Stack makes upgrading these frameworks easy.

Ubuntu 20.04
TensorFlow
PyTorch
Jupyter
NVIDIA CUDA
NVIDIA cuDNN

Technical specifications

GPUs

Up to 8 GPUs · NVIDIA® A100, RTX A6000, RTX A5000, and RTX A4000 options

Up to 8 GPUs. Options include:

  • NVIDIA® A100: 40 GB of HBM2e, 6,912 CUDA cores, 432 Tensor Cores, PCIe 4.0
  • NVIDIA® RTX A6000: 48 GB of GDDR6, 10,752 CUDA cores, 336 Tensor Cores, PCIe 4.0
  • NVIDIA® RTX A5000: 24 GB of GDDR6, 8,192 CUDA cores, 256 Tensor Cores, PCIe 4.0
  • NVIDIA® RTX A4000: 16 GB of GDDR6, 6,144 CUDA cores, 192 Tensor Cores, PCIe 4.0

Processors

2 AMD EPYC™ 7003 series CPUs · Up to 64 cores, 256 threads, 256 MB cache per processer...

2 AMD EPYC™ 7003 series CPUs. Options include:

  • AMD EPYC 7313: 16 cores, 32 threads, 3.0 GHz base, 3.70 GHz boost, 128 MB cache
  • AMD EPYC 7413: 24 cores, 48 threads, 2.65 GHz base, 3.60 GHz boost, 128 MB cache
  • AMD EPYC 7513: 32 cores, 64 threads, 2.60 GHz base, 3.65 GHz boost, 128 MB cache
  • AMD EPYC 7643: 48 cores, 96 threads, 2.30 GHz base, 3.60 GHz boost, 256 MB cache
  • AMD EPYC 7663: 56 cores, 112 threads, 2.0 GHz base, 3.50 GHz boost, 256 MB cache
  • AMD EPYC 7713: 64 cores, 128 threads, 2.0 GHz base, 3.675 GHz boost, 256 MB cache
  • AMD EPYC 7763: 64 cores, 128 threads, 2.45 GHz base, 3.50 GHz boost, 256 MB cache

System memory

Up to 2048 GB of 3200 MHz DDR4 ECC RAM in 16 DIMM slots · 8 memory channels per processor

  • Up to 2048 GB of 3200 MHz DDR4 ECC RAM in 16 DIMM slots
  • 8 memory channels per processor

Operating system drive

Up to 15.36 TB of storage via one 2.5" NVME SSD (PCIe 3.x)

Up to 15.36 TB of storage via one 2.5" NVME SSD (PCIe 3.x)

Additional storage drives

Up to 46.08 TB of additional storage via 3 hot-swappable 2.5" NVMe SSDs (PCIe 3.x) · Designed...

  • Up to 46.08 TB of extra storage via 3 hot-swappable 2.5" NVMe SSDs (PCIe 3.x)
  • Designed to store large data sets and model checkpoints

Networking

Up to 2 high-speed Ethernet or Infiniband NICs · 2 RJ45 10 Gbps BASE-T LAN ports · 1 RJ45...

Built-in networking:

  • 2 RJ45 10 Gbps BASE-T LAN ports
  • 1 RJ45 10/100/1000 Mbps BASE-T LAN out-of-band management port

Up to 2 high-speed NICs. Options include:

  • 200 Gbps InfiniBand NVIDIA HDR ConnectX-6 VPI Adapter Card, 2x QSFP56, PCIe 4.0 x16
  • 200 Gbps InfiniBand NVIDIA HDR ConnectX-6 VPI Adapter Card, 1x QSFP56, PCIe 4.0 x16
  • 100 Gbps InfiniBand NVIDIA HDR100 ConnectX-6 VPI Adapter Card, 1x QSFP56, PCIe 4.0 x16
  • 100 Gbps InfiniBand NVIDIA HDR100 ConnectX-6 VPI Adapter Card, 2x QSFP56, PCIe 4.0 x16
  • 200 Gbps Ethernet NVIDIA ConnectX-6 EN Adapter Card, 2x QSFP56, PCIe 4.0 x16
  • 200 Gbps Ethernet NVIDIA ConnectX-6 Dx EN Adapter Card, 1x QSFP56, PCIe 4.0 x16
  • 100 Gbps Ethernet NVIDIA ConnectX-6 EN Adapter Card, 2x QSFP56, PCIe 4.0 x16
  • 100 Gbps Ethernet NVIDIA ConnectX-6 Dx EN Adapter Card, 1x QSFP56, PCIe 4.0 x16

Power

Two 2200 watt 80 PLUS™ Platinum power supplies · 2 + 0 redundancy...

  • Two 2200 watt 80 PLUS™ Platinum power supplies
  • 2 + 0 redundancy

AC input:

  • 200-240 Vac / 12.6 amperes / 47-63 Hz

Max output per PSU:

  • 200-240V Vac: 2200 watts

Front I/O

Power button with LED · Reset button · UID button with LED · System status LED · 2 LAN activity...

  • Power button with LED
  • Reset button
  • UID button with LED
  • System status LED
  • 2 LAN activity LEDs, one for each RJ45 10 Gbps BASE-T LAN port
  • Storage drive activity LED

Rear I/O

VGA port · 2 USB 3.0 ports · Power button with LED · Reset button · UID button with LED · NMI...

  • VGA port
  • 2 USB 3.0 ports
  • Power button with LED
  • Reset button
  • UID button with LED
  • NMI button
  • System status LED

Accessories

Rackmounting kit · C19 to C20, 15AWG, 250V/15A, 6 foot power cables

  • Rackmounting kit
  • 2 C19 to C20, 15AWG, 250V/15A, 6 foot power cables

Dimensions & weight

2 rack units (2U) · 17.64 in (width) x 3.4 in (height) x 31.5 in (depth) · 99 lbs with packaging...

  • Form factor: 2U rackmount
  • Width: 17.64 inches (448 mm)
  • Height: 3.4 inches (87.5 mm)
  • Depth: 31.5 inches (800 mm)
  • Server weight: 73 lbs (33 kg)
  • Rackmounting kit weight: 5 lbs (2.3 kg)
  • Total weight with packaging: 99 lbs (45 kg)

GPUs

Up to 8 GPUs · NVIDIA® A100, RTX A6000, RTX A5000, and RTX A4000 options

Up to 8 GPUs. Options include:

  • NVIDIA® A100: 40 GB of HBM2e, 6,912 CUDA cores, 432 Tensor Cores, PCIe 4.0
  • NVIDIA® RTX A6000: 48 GB of GDDR6, 10,752 CUDA cores, 336 Tensor Cores, PCIe 4.0
  • NVIDIA® RTX A5000: 24 GB of GDDR6, 8,192 CUDA cores, 256 Tensor Cores, PCIe 4.0
  • NVIDIA® RTX A4000: 16 GB of GDDR6, 6,144 CUDA cores, 192 Tensor Cores, PCIe 4.0

Processors

2 AMD EPYC™ 7003 or Intel® Xeon® Scalable series CPUs · Up to 64 cores, 256 threads, 256 MB cache...

2 AMD EPYC™ 7003 series CPUs. Options include:

  • AMD EPYC 7313: 16 cores, 32 threads, 3.0 GHz base, 3.70 GHz boost, 128 MB cache, PCIe 4.0
  • AMD EPYC 7413: 24 cores, 48 threads, 2.65 GHz base, 3.60 GHz boost, 128 MB cache, PCIe 4.0
  • AMD EPYC 7513: 32 cores, 64 threads, 2.60 GHz base, 3.65 GHz boost, 128 MB cache, PCIe 4.0
  • AMD EPYC 7643: 48 cores, 96 threads, 2.30 GHz base, 3.60 GHz boost, 256 MB cache, PCIe 4.0
  • AMD EPYC 7663: 56 cores, 112 threads, 2.0 GHz base, 3.50 GHz boost, 256 MB cache, PCIe 4.0
  • AMD EPYC 7713: 64 cores, 128 threads, 2.0 GHz base, 3.675 GHz boost, 256 MB cache, PCIe 4.0
  • AMD EPYC 7763: 64 cores, 128 threads, 2.45 GHz base, 3.50 GHz boost, 256 MB cache, PCIe 4.0

System memory

Up to 4096 GB of 3200 MHz DDR4 ECC RAM in 32 DIMM slots · 8 memory channels per processor

  • Up to 4096 GB of 3200 MHz DDR4 ECC RAM in 32 DIMM slots
  • 8 channels per processor

Operating system drive

Up to 15.36 TB of storage via one 2.5" NVME SSD (PCIe 3.x or PCIe 4.0)

Up to 15.36 TB of storage via one 2.5" NVME SSD (PCIe 3.x or PCIe 4.0)

Additional storage drives

Up to 46.08 TB of additional storage via 3 hot-swappable 2.5" NVMe SSDs (PCIe 3.x or 4.0) · Designed...

  • Up to 46.08 TB of additional storage via 3 hot-swappable 2.5" NVMe SSDs (PCIe 3.x or 4.0)
  • Designed to store large data sets and model checkpoints

Networking

Optional high-speed Ethernet or Infiniband NIC · 2 RJ45 1 Gbps BASE-T LAN ports · 1 RJ45...

Built-in networking:

  • 2 RJ45 1 Gbps BASE-T LAN ports
  • 1 RJ45 10/100/1000 Mbps BASE-T LAN out-of-band management port

Optional high-speed NIC. Options include:

  • 200 Gbps InfiniBand NVIDIA HDR ConnectX-6 VPI Adapter Card, 2x QSFP56, PCIe 4.0 x16
  • 200 Gbps InfiniBand NVIDIA HDR ConnectX-6 VPI Adapter Card, 1x QSFP56, PCIe 4.0 x16
  • 100 Gbps InfiniBand NVIDIA HDR100 ConnectX-6 VPI Adapter Card, 1x QSFP56, PCIe 4.0 x16
  • 100 Gbps InfiniBand NVIDIA HDR100 ConnectX-6 VPI Adapter Card, 2x QSFP56, PCIe 4.0 x16
  • 200 Gbps Ethernet NVIDIA ConnectX-6 EN Adapter Card, 2x QSFP56, PCIe 4.0 x16
  • 200 Gbps Ethernet NVIDIA ConnectX-6 Dx EN Adapter Card, 1x QSFP56, PCIe 4.0 x16
  • 100 Gbps Ethernet NVIDIA ConnectX-6 EN Adapter Card, 2x QSFP56, PCIe 4.0 x16
  • 100 Gbps Ethernet NVIDIA ConnectX-6 Dx EN Adapter Card, 1x QSFP56, PCIe 4.0 x16

Power

4 hot-swappable 2000 watt 80 PLUS™ Titanium power supplies · 2 + 2 redundancy...

  • 4 hot-swappable 2000 watt 80 PLUS™ Titanium power supplies
  • 2 + 2 redundancy

AC input:

  • 100-127 Vac / 12-9.0 amperes / 50-60 Hz
  • 200-220 Vac / 10-9.8 amperes / 50-60 Hz
  • 220-230 Vac / 10-9.8 amperes / 50-60 Hz
  • 230-240 Vac / 10-9.8 amperes / 50-60 Hz

Max output per PSU:

  • 100–127 Vac: 1000 watts
  • 200–220 Vac: 1800 watts
  • 220–230 Vac: 1980 watts
  • 230–240 Vac: 2000 watts

Front I/O

Power button · Reset button · Power LED · ID button with LED · Information LED · Power supply...

  • Power button
  • Reset button
  • Power LED
  • ID button with LED
  • Information LED
  • Power supply failure LED
  • 2 LAN activity LEDs, one for each RJ45 1 Gbps BASE-T LAN port
  • Storage drive activity LED

Rear I/O

VGA port · 2 USB 3.0 ports · Serial port · 2 RJ45 1 Gbps BASE-T LAN ports · 1 RJ45 10/100/1000...

  • VGA port
  • 2 USB 3.0 ports
  • 2 RJ45 10 Gbps BASE-T LAN ports
  • 1 RJ45 10/100/1000 Mbps BASE-T LAN out-of-band management port

Dimensions & weight

4 rack units (2U) · 17.2 in (width) x 7.0 in (height) x 29.0 in (depth) · 100 lbs with packaging...

  • Form factor: 4U rackmount
  • Width: 17.2 inches (437 mm)
  • Height: 7.0 inches (179 mm)
  • Depth: 29.0 inches (737 mm)
  • Server weight: 73 lbs (33 kg)
  • Rackmounting kit weight: 5 lbs (2.3 kg)
  • Total weight with packaging: 99 lbs (45 kg)

Our published research

View all research