Starting today you can now spin up virtual machines with 1, 2, or 4 NVIDIA® Quadro RTX™ 6000 GPUs on Lambda's GPU cloud. We’ve built this new general purpose GPU instance type based on feedback we’ve collected from users over the past few months, and we are excited to finally bring it out of early access. With the new RTX 6000 instance types you can now expect:
With the new instances we’ve been able to lower the starting price of GPU compute on Lambda Cloud. Our 1-GPU instance now starts at $0.75 / hr compared to our previously lowest price Pascal based GPU instance that started at $1.50 / hr. The prices for the new instances are as follows:
We heard a lot from customers about wanting more variety in choosing GPUs for their VMs as well as how much they benefited from the extremely fast NVMe storage and increased RAM on our 8-GPU V100 instances. So, with the new instances we wanted to make sure users have the best of both worlds.
1-GPU RTX 6000
2-GPU RTX 6000
4-GPU RTX 6000
The achilles heel of our now legacy 4-GPU Pascal based GPU instance was the lack of preinstalled up-to-date frameworks and drivers. While it wasn’t something we could address on the older instances, we’ve made sure our new instances come preinstalled with Tensorflow 2.3, PyTorch 1.6, Python 3.8, and CUDA 10. In addition, all machines come with a JupyterLab notebook environment and direct SSH access, so you can get started training right away.
At Lambda we focus on providing cost effective and easy to use compute for machine learning researchers and engineers, so it was important that we do a price / performance benchmark of our 4-GPU on-demand instance against one of the most commonly available 4-GPU cloud instances, the p3.8xlarge.
To do this we first ran a comprehensive set of PyTorch model benchmarks on both our 4-GPU RTX 6000 instance and the p3.8xlarge. The benchmark covers a wide gamut of tasks including: image classification, language models, machine translation, speech synthesis, and recommendation systems.
If we take the average of the performance difference between the two instances we see that the 4-GPU RTX 6000 instance performance is roughly 80% of what you might expect on the p3.8xlarge. However, the 4-GPU RTX 6000 instance is also roughly 40% the price of a p3.8xlarge instance ($3.00 / hr vs $12.24 / hr).
So, that means that the 4-GPU RTX 6000 GPU instance provides roughly 4x the performance per dollar of a comparable p3.8xlarge instance.
Just like the rest of our instances the new RTX 6000 instances are not spot instances. So, even at the affordable prices, you have full on-demand access to instances without having to worry about them being terminated at an inconvenient moment.
To get started with Lambda's GPU Cloud you can sign up here or, if you’re already a customer, sign in and launch a new 1, 2, or 4-GPU instance starting at $0.75 / hr.