Lambda GPU Cloud | Frequently Asked Questions (FAQ)

Getting started

What libraries come preinstalled on Lambda Cloud instances?

Instances come preinstalled with CUDA, Python 3, Tensorflow, CuArrays, PyTorch®, Plots, Julia, Flux, and Zygote.

Which operating systems are available on Lambda Cloud?

Lambda Cloud instances run Ubuntu Server 22.04 LTS + Lambda Stack. Instances are only accessible via SSH or the included Jupyter Notebook. We do not currently support any other operating systems or access via a typical desktop graphical user interface (GUI).

Can I install my own DL/ML libraries and dependencies?

You can install any library that supports Ubuntu 22.04. Dependencies can be installed using the apt-get command for the Advanced Package Tool (APT) available in Ubuntu.

I'm new to SSH, how do I use the .pem private key?

See our documentation on adding, generating, and deleting SSH key using the Cloud dashboard. You can also watch our getting started video tutorial.

How do I use persistent storage to save datasets and system state?

You can use the Lambda Cloud Storage feature to save datasets and system state. You can also create containers. See the FAQ on our docs site for more information.

How long does it take for instances to launch?

Single-GPU instances usually take 3-5 minutes to launch. Multi-GPU instances usually take 10-15 minutes to launch.

How do I upload and download models & data to my instances from my local machine?

Check out our how to guide on transferring data to and from your instance. Please note: If an instance is terminated, all data will be deleted, so it’s important to backup results to either your local machine or external cloud storage.

How do I shutdown / terminate the instance?

It is recommended to terminate instances using the Lambda Cloud dashboard and will be billed until terminated in the dashboard. You can also use the Cloud API to terminate instances. Please note: Terminating an instance permanently deletes all data on the instance.

How do I upload and download models & data to my instances from S3 or Google Cloud Storage?

How do I get started using the Team feature?

Check out our guide to get started using the Team feature.

Why can't my program find the NVIDIA cuDNN library?

On our instances, the NVIDIA cuDNN library is installed in a non-standard location. See the FAQ on our docs site for more information.

How do I get started using the Team feature?

Check out our guide to get started using the Team feature.

Where can I find documentation for using Lambda Cloud?

You can find documentation for using Lambda Cloud at the Lambda Docs site.

Who can use Lambda Cloud?

Users from the following regions can use Lambda Cloud: USA, Canada, Chile, European Union (except for Romania), Switzerland, UK, Iceland, UAE, Saudi Arabia, South Africa, Israel, Taiwan, Korea, Japan, Singapore, Australia, and New Zealand.

General

Can I use Blender or other rendering programs on Lambda Cloud?

Lambda Cloud instances do not support graphical user interfaces (GUI) and are optimized for deep learning. Using a cloud instance as a remote render farm instance is possible, but it is not a supported use case.

Can I mine Bitcoin or other cryptocurrency on Lambda Cloud?

Lambda Cloud is intended for deep learning use cases. Mining Bitcoin or other cryptocurrency mining is not allowed.

Can my data be recovered once I've terminated my instance?

We cannot recover your data once your instance has been terminated! Make sure to backup up all data that you want to keep!

I think you might be down. Do you have a status page?

For the latest service outage and maintenance updates please check the Lambda Cloud status page.

Billing

How are instances billed?

On-demand instances are billed in one-minute increments, beginning the moment you spin up (start) the instance and the instance passes health checks. Billing ends the moment you terminate (stop) the instance. Instances are billed for as long as they're running, regardless if they're actively being used.

How are refunds given?

Refunds are given in the form of credit toward future Cloud usage only. The credit can't be redeemed for cash (for example, refund to a card) and can't be used toward purchases of other Lambda products. The credit expires 12 months after it is given, is nontransferable, and is subject to the Lambda Cloud Terms of Service.

How are persistent storage file systems billed?

File systems are billed per GB used per month in increments of 1 hour. See our FAQ regarding file system billing for more information.

How do I close my account?

To close your account, navigate to “Settings” in your Lambda GPU Cloud dashboard. After closing your account, you will no longer be able to log in and your data will be lost.

Do I have to pay sales tax for Lambda GPU Cloud?

As of March 1, 2024, sales tax is charged based on your billing address. Be sure to always keep your billing address up to date.

Does Lambda offer credits for students or researchers?

We do provide credits on a case-by-case basis. However, we're currently at capacity and, at this time, aren't providing credits. Once additional capacity becomes available, contact Support to request credits for your event or project.

Why is my card being declined?

We don't accept debit cards, prepaid cards, charges made from certain countries, and charges made while connected to a VPN. See our FAQ regarding declined card payments for more information.

Why did I receive an email saying 3D secure authentication is required to process my payment?

Lambda recently moved to a new billing system. As part of this move, you might receive an email saying your payment was declined because 3D secure authentication is required. If you receive this email and the card you have on file is still valid, your payment should go through in the next billing cycle. Alternatively, you can log into your account and reenter your card information to proceed with 3D secure authentication.

Security

Does Lambda Cloud support multi-user access?

You can use the Team feature for multi-user access to Lambda Cloud. If you would like to set up different instances for different users, you can attach a unique private key to each new instance. If you would like to have multiple users share a single instance, you can use Ubuntu’s built in multi-user access controls to give each user their own account.

Instance information

Where are instances available?

We have instances available in the following regions:

Arizona, USA
California, USA
Illinois, USA
Texas, USA
Utah, USA
Virginia, USA
Germany
India
Israel
Italy
Osaka, Japan
Tokyo, Japan
Sydney, Australia

Can I spin up multiple instances on Lambda Cloud?

Yes, you can spin up multiple instances in the dashboard or using the Cloud API.

What are the network speeds available on Lambda Cloud instances?

Depending on the instance type network burst speeds can range from 1 Gbps to 10 Gbps.

Can I only use a subset of GPUs available on each Lambda instance and pay only for the number of GPUs that I am using?

We currently have instance types with 1x, 2x, 4x or 8x GPUs. It is not possible to only pay for a partial number of GPUs in an instance.

API & advanced usage

How can I perform distributed training on multiple instances on Lambda Cloud?

Distributed training can be performed across multiple instances using a framework like Horovod. We recommend only using the same instance type for each node when clustering instances. The maximum inter-node connectivity is 10 Gbps.

Can I launch an instance from a command line or from a script?

You can launch instances from a command line or from a script using the Cloud API.

How do I terminate an instance using the Cloud API?

For step-by-step instructions on how to terminate an instance using the Cloud API, see the FAQ on our docs site.