The Lambda Deep Learning Blog

Featured Posts

Recent Posts

NVIDIA GeForce RTX 4090 vs RTX 3090 Deep Learning Benchmark

In this blog post, we benchmark RTX 4090 to assess its deep learning training performance and compare its performance against RTX 3090, the flagship consumer GPU of the previous Ampere generation.

Published 10/31/2022 by Chuan Li

All You Need Is One GPU: Inference Benchmark for Stable Diffusion

Lambda presents an inference benchmark of Stable Diffusion model with different GPUs and CPUs.

Published 10/05/2022 by Eole Cervenka

NVIDIA H100 GPU - Deep Learning Performance Analysis

Discuss the performance and scalability of H100 GPUs and the whys for upgrading your ML infrastructure with this upcoming big release from NVIDIA.

Published 10/05/2022 by Chuan Li

NVIDIA A40 Deep Learning Benchmarks

NVIDIA® A40 GPUs are now available on Lambda Scalar servers [https://lambdalabs.com/products/scalar]. In this post, we benchmark the A40 with 48 GB of GDDR6 VRAM to assess its training performance using PyTorch and TensorFlow. We then compare it against the NVIDIA V100, RTX 8000, RTX 6000, and RTX 5000.

Published 11/30/2021 by Chuan Li

Tesla A100 Server Total Cost of Ownership Analysis

This post discusses the Total Cost of Ownership (TCO) for a variety of Lambda A100 servers and clusters. We first calculate the TCO for individual Hyperplane-A100 servers, and compare the cost with renting a AWS p4d.24xlarge instance which has the similar hardware and software set up. We then walk you through the cost of building and operating A100 clusters.

Published 09/22/2021 by Chuan Li

RTX A6000 vs RTX 3090 Deep Learning Benchmarks

PyTorch benchmarks of the RTX A6000 and RTX 3090 for convnets and language models - both 32-bit and mix precision performance.

Published 08/09/2021 by Chuan Li

A100 vs V100 Deep Learning Benchmarks

PyTorch & TensorFlow benchmarks of the Tesla A100 and V100 for convnets and language models - both both 32-bit and mix precision performance.

Published 01/28/2021 by Michael Balaban

RTX A6000 Deep Learning Benchmarks

PyTorch and TensorFlow training speeds on models like ResNet-50, SSD, and Tacotron 2. Compare performance of the RTX 3090, 3080, A100, V100, and A6000 .

Published 01/04/2021 by Michael Balaban

NVIDIA A100 GPU Benchmarks for Deep Learning

Benchmarks for ResNet-152, Inception v3, Inception v4, VGG-16, AlexNet, SSD300, and ResNet-50 using the NVIDIA A100 GPU and DGX A100 server.

Published 05/22/2020 by Stephen Balaban

Choosing the Best GPU for Deep Learning in 2020

This blog summarizes our GPU benchmark for training State of the Art (SOTA) deep learning models. We measure each GPU's performance by batch capacity as well as...

Published 02/18/2020 by Michael Balaban

Titan V Deep Learning Benchmarks with TensorFlow

Titan V vs. RTX 2080 Ti vs. RTX 2080 vs. Titan RTX vs. Tesla V100 vs. GTX 1080 Ti vs. Titan Xp - TensorFlow benchmarks for neural net training.

Published 03/12/2019 by Michael Balaban

RTX 2080 Ti Deep Learning Benchmarks with TensorFlow

RTX 2080 Ti vs. RTX 2080 vs. Titan RTX vs. Tesla V100 vs. Titan V vs. GTX 1080 Ti vs. Titan Xp benchmarks neural net training.

Published 03/04/2019 by Stephen Balaban

Perform GPU, CPU, and I/O stress testing on Linux

CPU, GPU, and I/O utilization monitoring using tmux, htop, iotop, and nvidia-smi. This stress test is running on a Lambda GPU Cloud [https://lambdalabs.com/service/gpu-cloud] 4x GPU instance.Often times you'll want to put a system through the paces after it's been set up. To stress test

Published 02/17/2019 by Stephen Balaban

...

Next page