GPU benchmarks for training State of the Art (SOTA) deep learning models. We measure each GPU's performance by batch capacity and more.
The Lambda Deep Learning Blog
Categories
- gpu-cloud (25)
- tutorials (24)
- benchmarks (22)
- announcements (19)
- lambda cloud (13)
- NVIDIA H100 (12)
- hardware (12)
- tensorflow (9)
- NVIDIA A100 (8)
- gpus (8)
- company (7)
- LLMs (6)
- deep learning (6)
- hyperplane (6)
- training (6)
- gpu clusters (5)
- news (5)
- CNNs (4)
- generative networks (4)
- presentation (4)
- rtx a6000 (4)
Recent Posts
Titan V vs. RTX 2080 Ti vs. RTX 2080 vs. Titan RTX vs. Tesla V100 vs. GTX 1080 Ti vs. Titan Xp - TensorFlow benchmarks for neural net training.
Published 03/12/2019 by Michael Balaban
RTX 2080 Ti vs. RTX 2080 vs. Titan RTX vs. Tesla V100 vs. Titan V vs. GTX 1080 Ti vs. Titan Xp benchmarks neural net training.
Published 03/04/2019 by Stephen Balaban
How to stress test a system for simultaneous GPU and CPU loads using two stress tools, stress and gpu_burn, and three monitoring tools, htop, iotop and nvidia-smi.
Published 02/17/2019 by Stephen Balaban
A cost and speed comparison between the Lambda Hyperplane 8 V100 GPU Server and AWS p3 GPU instances. A very similar comparison to the DGX-1.
Published 02/11/2019 by Chuan Li
This blog tests how fast does ResNet9 (the fastest way to train a SOTA image classifier on Cifar10) run on Nvidia's Turing GPUs, including 2080 Ti and Titan RTX. We also include 1080 Ti as the baseline for comparison.
Published 01/07/2019 by Chuan Li
Titan RTX vs. 2080 Ti vs. 1080 Ti vs. Titan Xp vs. Titan V vs. Tesla V100. For this post, Lambda engineers benchmarked the Titan RTX's deep learning performance vs. other common GPUs. We measured the Titan RTX's single-GPU training performance on ResNet50, ResNet152, Inception3, Inception4, VGG16, AlexNet, and SSD.
Published 12/26/2018 by Michael Balaban
We open sourced the benchmarking code we use at Lambda so that anybody can reproduce the benchmarks that we publish or run their own.
Published 10/12/2018 by Stephen Balaban
What's the best GPU for Deep Learning? The 2080 Ti. We benchmark the 2080 Ti vs the Titan V, V100, and 1080 Ti.
Published 10/08/2018 by Stephen Balaban