Lambda GPU Cloud | Frequently Asked Questions (FAQ)

What libraries come preinstalled on Lambda Cloud instances?

Instances come preinstalled with CUDA, Python 3, Tensorflow, CuArrays, PyTorch®, Plots, Julia, Flux, and Zygote.

Can I install my own DL/ML libraries and dependencies?

You can install any library that supports Ubuntu 22.04. Dependencies can be installed using the apt-get command for the Advanced Package Tool (APT) available in Ubuntu.

How do I use persistent storage to save datasets and system state?

You can use the Lambda Cloud Storage feature to save datasets and system state. You can also create containers. See the FAQ on our docs site for more information.

How do I upload and download models & data to my instances from my local machine?

Check out our how to guide on transferring data to and from your instance. Please note: If an instance is terminated, all data will be deleted, so it’s important to backup results to either your local machine or external cloud storage.

How do I upload and download models & data to my instances from S3 or Google Cloud Storage?

Why can't my program find the NVIDIA cuDNN library?

On our instances, the NVIDIA cuDNN library is installed in a non-standard location. See the FAQ on our docs site for more information.

Where can I find documentation for using Lambda Cloud?

You can find documentation for using Lambda Cloud at the Lambda Docs site.

Which operating systems are available on Lambda Cloud?

Lambda Cloud instances run Ubuntu Server 22.04 LTS + Lambda Stack. Instances are only accessible via SSH or the included Jupyter Notebook. We do not currently support any other operating systems or access via a typical desktop graphical user interface (GUI).

I'm new to SSH, how do I use the .pem private key?

See our documentation on adding, generating, and deleting SSH key using the Cloud dashboard. You can also watch our getting started video tutorial.

How long does it take for instances to launch?

Single-GPU instances usually take 3-5 minutes to launch. Multi-GPU instances usually take 10-15 minutes to launch.

How do I shutdown / terminate the instance?

It is recommended to terminate instances using the Lambda Cloud dashboard and will be billed until terminated in the dashboard. You can also use the Cloud API to terminate instances. Please note: Terminating an instance permanently deletes all data on the instance.

How do I get started using the Team feature?

Check out our guide to get started using the Team feature.

Who can use Lambda Cloud?

Users from the following regions can use Lambda Cloud: USA, Canada, Chile, European Union (except for Romania), Switzerland, UK, Iceland, UAE, Saudi Arabia, South Africa, Israel, Taiwan, Korea, Japan, Singapore, Australia, and New Zealand.

How are instances billed?

On-demand instances are billed in one-minute increments, beginning the moment you spin up (start) the instance and the instance passes health checks. Billing ends the moment you terminate (stop) the instance. Instances are billed for as long as they're running, regardless if they're actively being used.

How are persistent storage file systems billed?

File systems are billed per GB used per month in increments of 1 hour. See our FAQ regarding file system billing for more information.

Do I have to pay sales tax for Lambda GPU Cloud?

As of March 1, 2024, sales tax is charged based on your billing address. Be sure to always keep your billing address up to date.

Why is my card being declined?

We don't accept debit cards, prepaid cards, charges made from certain countries, and charges made while connected to a VPN. See our FAQ regarding declined card payments for more information.

Why did I receive an email saying 3D secure authentication is required to process my payment?

Lambda recently moved to a new billing system. As part of this move, you might receive an email saying your payment was declined because 3D secure authentication is required. If you receive this email and the card you have on file is still valid, your payment should go through in the next billing cycle. Alternatively, you can log into your account and reenter your card information to proceed with 3D secure authentication.

How are refunds given?

Refunds are given in the form of credit toward future Cloud usage only. The credit can't be redeemed for cash (for example, refund to a card) and can't be used toward purchases of other Lambda products. The credit expires 12 months after it is given, is nontransferable, and is subject to the Lambda Cloud Terms of Service.

How do I close my account?

To close your account, navigate to “Settings” in your Lambda GPU Cloud dashboard. After closing your account, you will no longer be able to log in and your data will be lost.

Does Lambda offer credits for students or researchers?

We do provide credits on a case-by-case basis. However, we're currently at capacity and, at this time, aren't providing credits. Once additional capacity becomes available, contact Support to request credits for your event or project.

Can I spin up multiple instances on Lambda Cloud?

Yes, you can spin up multiple instances in the dashboard or using the Cloud API.

What are the network speeds available on Lambda Cloud instances?

Depending on the instance type network burst speeds can range from 1 Gbps to 10 Gbps.

Can I only use a subset of GPUs available on each Lambda instance and pay only for the number of GPUs that I am using?

We currently have instance types with 1x, 2x, 4x or 8x GPUs. It is not possible to only pay for a partial number of GPUs in an instance.

How can I perform distributed training on multiple instances on Lambda Cloud?

Distributed training can be performed across multiple instances using a framework like Horovod. We recommend only using the same instance type for each node when clustering instances. The maximum inter-node connectivity is 10 Gbps.

Can I launch an instance from a command line or from a script?

You can launch instances from a command line or from a script using the Cloud API.

How do I terminate an instance using the Cloud API?

For step-by-step instructions on how to terminate an instance using the Cloud API, see the FAQ on our docs site.

Frequently Asked Questions (FAQ)

Getting Started