The world's fastest server for AI research
Now available with NVIDIA H100 Tensor Core GPUs
10,000+ research teams trust Lambda
Lambda Prviate Cloud with NVIDIA H100 GPUs and AMD EPYC 9004 series CPUs
Lambda’s Hyperplane HGX server, with NVIDIA H100 GPUs and AMD EPYC 9004 series CPUs, is now available for order in Lambda Private Cloud, starting at $1.89 per H100 per hour! By combining the fastest GPU type on the market with the world’s best data center CPU, you can train and run inference faster with superior performance per dollar.
Engineered for your workload
Tell us about your research and we'll design a machine that's perfectly tailored to your needs.
HYPERPLANE A100 | HYPERPLANE H100 | |
---|---|---|
GPUs | 4x or 8x A100 80GB SXM4 | 8x H100 80GB SXM5 |
CPUs | Up to 128 cores and 256 threads | Up to 192 cores and 384 threads |
Memory | Up to 8 TB DDR4 | Up to 8 TB DDR5 |
Storage | Up to 184 TB of NVMe SSDs | Up to 492 TB of NVMe SSDs |
Networking | Up to 200 Gb/s | Up to 400 Gb/s |
Easily scale from server to cluster
As your team's compute needs grow, Lambda's in-house HPC engineers and AI researchers can help you integrate Hyperplane and Scalar servers into GPU clusters designed for deep learning.
-
ComputeScaling to 1000s of GPUs for distributed training or hyperparameter optimization.
-
StorageHigh-performance parallel file systems optimized for ML.
-
NetworkingCompute and storage fabrics for GPUDirect RDMA and GPUDirect Storage.
-
SoftwareFully integrated software stack for MLOps and cluster management.
Service and support by technical experts who specialize in machine learning
Lambda Premium Support includes:
- Up to 5 year extended warranty with advanced parts replacement
- Live technical support from Lambda's team of ML engineers
- Support for ML software included in Lambda Stack: PyTorch®, Tensorflow, CUDA, CuDNN, and NVIDIA Drivers
Plug in. Start training.
Our servers include Lambda Stack, which manages frameworks like PyTorch® and TensorFlow. With Lambda Stack, you can stop worrying about broken GPU drivers and focus on your research.
-
Zero configuration requiredAll your favorite frameworks come pre-installed.
-
Easily upgrade PyTorch® and TensorFlowWhen a new version is released, just run a simple upgrade command.
-
No more broken GPU driversDrivers will "just work" and keep compatible with popular frameworks.
Your servers. Our datacenter.
Lambda Colocation makes it easy to deploy and scale your machine learning infrastructure. We'll manage racking, networking, power, cooling, hardware failures, and physical security. Your servers will run in a Tier 3 data center with state-of-the-art cooling that's designed for GPUs. You'll get remote access to your servers, just like a public cloud.
Explore our research
Multiple Pairwise Ranking Networks for Personalized Video Summarization
We propose a model for personalized video summaries by conditioning the summarization process with predefined categorical labels.
HoloGAN: Unsupervised Learning of 3D Reps. from Natural Images
We propose a novel generative adversarial network (GAN) for the task of unsupervised learning of 3D representations from natural images.
RenderNet: A Deep ConvNet for Differentiable Rendering from 3D Shapes
We present a differentiable rendering convolutional network with a novel projection unit that can render 2D images from 3D shapes.
Adversarial Monte Carlo Denoising with Conditioned Aux. Feature Modulation
We demonstrate that GANs can help denoiser networks produce more realistic high-frequency details and global illumination.
Technical Specifications
- 4 NVIDIA A100 SXM4 GPUs (80 GB)
- NVLink and PCIe 4.0 GPU-to-GPU interconnect
2 AMD EPYC™ or Intel Xeon Processors
- AMD EPYC 7003 (Milan) Series Processors with up to 112 cores total
- Intel Xeon 3rd Gen (Ice Lake) Scalable Processors with up to 80 cores total
- Up to 8 TB of 3200 MHz DDR4 ECC RAM in 32 DIMM slots
- Up to 122.88 TB of storage via 4 hot-swappable U.2 NVMe SSDs
Built-in networking:
- 2 RJ45 10 Gbps (aggregate) BASE-T LAN ports
- 1 RJ45 1 Gbps BASE-T LAN out-of-band management port
Up to 4 high-speed NICs for GPUDirect RDMA. Options include:
- NVIDIA ConnectX-6 200 Gb/s HDR InfiniBand/VPI Adapter, QSFP56, PCIe 4.0 x16
- NVIDIA ConnectX-6 100 Gb/s HDR100 InfiniBand/VPI Adapter, 1x QSFP56, PCIe 4.0 x16
- NVIDIA ConnectX-6 Dx EN 200 Gb/s Ethernet Adapter, QSFP56, PCIe 4.0 x16
- NVIDIA ConnectX-6 Dx EN 100 Gb/s Ethernet Adapter, QSFP56, PCIe 4.0 x16
- NVIDIA ConnectX-5 EN 100 Gb/s Ethernet Adapter, QSFP28, PCIe 3.0 x16
- 2 hot-swappable 2200W 80 PLUS™ Platinum PSUs
- 1 + 1 redundancy
- 220-240Vac / 11-10A / 50-60 Hz
- 220-240Vac / 2200 watts
- Power button and LED
- Reset button
- Information LED
- LAN activity LED (one for each port)
- HDD LED
- Power fail LED
- UID button and LED
- VGA port
- 2 USB 3.0 ports
- 2 RJ45 10 Gbps (aggregate) BASE-T LAN ports
- 1 RJ45 1 Gbps BASE-T LAN out-of-band management (IPMI) port
- Rackmounting kit
- 2 configurable C19 power cables
- Form factor: 2U rackmount
- Width: 17.2 inches (437 mm)
- Height: 3.5 inches (89 mm)
- Depth: 32.7 inches (830.3 mm)
- Server weight: 78.5 lbs (35.6 kg)
- Rackmounting kit weight: 5 lbs (2.3 kg)
- Total weight with packaging: 88.5 lbs (40.1 kg)
- 8 NVIDIA® A100 SXM4 GPUs (80 GB)
- NVLink and NVSwitch GPU-to-GPU fabric
2 AMD EPYC™ or Intel Xeon Processors
- AMD EPYC 7003 (Milan) Series Processors with up to 112 cores total
- Intel Xeon 3rd Gen (Ice Lake) Scalable Processors with up to 80 cores total
- Up to 8 TB of 3200 MHz DDR4 ECC RAM in 32 DIMM slots
- Up to 7.68 TB of storage via 2 onboard M.2 NVMe SSDs
- Up to 184.32 TB of storage via 6 hot-swappable U.2 NVMe SSDs
Built-in networking:
- 2 RJ45 10 Gbps BASE-T LAN ports
- 1 RJ45 1 Gbps BASE-T LAN out-of-band management port
Up to 9 high-speed NICs for GPUDirect RDMA and Storage. Options include:
- NVIDIA ConnectX-6 200 Gb/s HDR InfiniBand/VPI Adapter, QSFP56, PCIe 4.0 x16
- NVIDIA ConnectX-6 100 Gb/s HDR100 InfiniBand/VPI Adapter, 1x QSFP56, PCIe 4.0 x16
- NVIDIA ConnectX-6 Dx EN 200 Gb/s Ethernet Adapter, QSFP56, PCIe 4.0 x16
- NVIDIA ConnectX-6 Dx EN 100 Gb/s Ethernet Adapter, QSFP56, PCIe 4.0 x16
- NVIDIA ConnectX-5 EN 100 Gb/s Ethernet Adapter, QSFP28, PCIe 3.0 x16
- 4 hot-swappable 3000W 80 PLUS™ Titanium PSUs
- 2 + 2 redundancy
AC input:
- 210-240Vac / 16-14.5A / 50-60 Hz
Max output per PSU:
- 210-240Vac / 3000 watts
- Power button and LED
- UID button and LED
- BMC reset button
- Information LED
- LAN activity LED
- VGA port
- 2 USB 3.0 ports
- 1 RJ45 1 Gbps BASE-T LAN out-of-band management (IPMI) port
- 2 RJ45 10 Gbps BASE-T LAN ports
- Rackmounting kit
- 4 configurable C19 power cables
- Form factor: 4U rackmount
- Width: 17.6 inches (446 mm)
- Height: 6.9 inches (174 mm)
- Depth: 35.4 inches (900 mm)
- Server weight: 166 lbs (75.3 kg)
- Rackmounting kit weight: 5 lbs (2.3 kg)
- Total weight with packaging: 225 lbs (102.1 kg)
- 8 NVIDIA® H100 SXM5 GPUs (80 GB)
- NVLink and NVSwitch GPU-to-GPU fabric
2 AMD EPYC™ or Intel Xeon Processors
- AMD EPYC 7004 & 9004 (Genoa & Bergamo) Series Processors with up to 256 cores
- Intel Xeon 4th Gen (Sapphire Rapids) Scalable Processors with up to 112 cores total
- Up to 8 TB of 4800 MHz DDR5 ECC RAM in 32 DIMM slots
- Up to 7.68 TB of storage via 2 onboard M.2 NVMe SSDs
- Up to 491.52 TB of storage via 16 hot-swappable U.2 NVMe SSDs
Built-in networking:
- 2 RJ45 10 Gbps BASE-T LAN ports
- 1 RJ45 1 Gbps BASE-T LAN out-of-band management port
Up to 9 high-speed NICs for GPUDirect RDMA and Storage. Options include:
- NVIDIA ConnectX-7 400 Gb/s NDR InfiniBand Adapter, OSFP56, PCIe 5.0 x16
- NVIDIA ConnectX-7 200 Gb/s NDR200 InfiniBand Adapter, OSFP56, PCIe 5.0 x16
- NVIDIA ConnectX-7 200 Gb/s NDR200 InfiniBand/VPI Adapter, QSFP112, PCIe 5.0 x16
- NVIDIA ConnectX-6 200 Gb/s HDR InfiniBand/VPI Adapter, QSFP56, PCIe 4.0 x16
- NVIDIA ConnectX-6 100 Gb/s HDR100 InfiniBand/VPI Adapter, 1x QSFP56, PCIe 4.0 x16
- NVIDIA ConnectX-6 Dx EN 200 Gb/s Ethernet Adapter, QSFP56, PCIe 4.0 x16
- NVIDIA ConnectX-6 Dx EN 100 Gb/s Ethernet Adapter, QSFP56, PCIe 4.0 x16
- NVIDIA ConnectX-5 EN 100 Gb/s Ethernet Adapter, QSFP28, PCIe 3.0 x16
- 6 hot-swappable 3000W 80 PLUS Titanium PSUs
- 3 + 3 redundancy
AC input:
- 210-240Vac / 16-14.5A / 50-60 Hz
Max output per PSU:
- 210-240Vac / 3000 watts
- Power button and LED
- Reset button
- Information LED
- LAN activity LED (one for each port)
- HDD LED
- Power fail LED
- UID button and LED
- VGA port
- 2 USB 3.0 ports
- 2 RJ45 10 Gbps BASE-T LAN ports
- 1 RJ45 1 Gbps BASE-T LAN out-of-band management (IPMI) port
- Rackmounting kit
- 6 configurable C19 power cables
- Form factor: 8U rackmount
- Width: 17.2 inches (437 mm)
- Height: 14 inches (356 mm)
- Depth: 31.5 inches (800 mm)