Introducing NVIDIA RTX™ A6000 GPU Instances on Lambda Cloud

New 2 & 4 GPU cloud instances with NVIDIA RTX A6000 GPUs.

We are excited to announce today that Lambda GPU Cloud is the first public cloud to offer instances with 2x and 4x NVIDIA RTX A6000 GPUs! We have been working hard behind the scenes to launch A6000s instances and provide a unique cloud GPU option for engineers and researchers. A quick overview of what’s new:

  • First cloud NVIDIA RTX A6000s, providing great price to performance value
  • ~2x average performance improvement over our previous 2x & 4x NVIDIA RTX 6000 instances
  • 48 GiB of VRAM per GPU for higher memory workloads and larger batch sizes
  • NVLink support between pairs of GPUs for faster GPU-to-GPU communication
  • Up to 200 Gbps of inter-node bandwidth for faster multi-node training
Sign up for Lambda GPU Cloud

Instance Specs & Pricing

Our new 2 and 4 GPU instances are powered by AMD EPYC™ 7502 CPUs and paired with high speed NVMe offering up to 6x the performance of standard SATA3 SSDs. These VMs have been designed and built to be great for general purpose, high memory, and multi-node workloads.

2-GPU NVIDIA RTX A6000 @ $4.50 / hr

  • GPU: 2x NVIDIA RTX A6000 + NVLink (48 GiB VRAM each)
  • CPU: 28 vCPUs @ 2.5 GHz
  • RAM: 200 GiB
  • Temporary Storage: 1 TiB NVMe
  • Node-to-node Bandwidth: Up to 200 Gbps
  • Internet Bandwidth: Up to 10 Gbps

4-GPU NVIDIA RTX A6000 @ $9.00 / hr

  • GPU: 4x NVIDIA RTX A6000 + NVLink (48 GiB VRAM each)
  • CPU: 56 vCPUs @ 2.5 GHz
  • RAM: 400 GiB
  • Temporary Storage: 1 TiB NVMe
  • Node-to-node Bandwidth: Up to 200 Gbps
  • Internet Bandwidth: Up to 10 Gbps

Performance & Benchmarks

With each new generation of GPU instances we aim to provide an even better value than the previous generation. Our NVIDIA RTX A6000 instances are no exception, and we’ve been able to provide on-demand price to performance numbers that beat p3.8xlarge instances by an average of 150% and even our existing already affordable NVIDIA RTX 6000 instances by an average of 10%.

To calculate the performance figures we trained a handful of different models using PyTorch with FP32 precision and averaged out the numbers across the comparable 4 GPU instance types.

A6000 compute per dollar comparison vs RTX 6000s and p3.8xlarge.

Savings without Yearly Contract Lock-in

Our new NVIDIA RTX A6000 instances not only provide more performance per dollar than on-demand p3.8xlarge instances, but they still provide an average of 60% more performance per dollar spent vs 1 year reserved instance. Even when the entire year is being paid upfront!

What’s Next?

You can sign up for Lambda GPU Cloud and start using our 2x and 4x NVIDIA A6000 instances today, but they’re just the beginning. We’re also working on 1x and 8x NVIDIA A6000 instances as well! If you’d like to have the opportunity to try them first, fill out our beta program questionnaire, and we’ll get back to you as things get closer to launch.