Benchmarks comparing inference performance of the NVIDIA GH200 Grace Hopper Superchip, enhanced by ZeRO-Inference, to NVIDIA H100 and A100 Tensor Core GPUs.
The Lambda Deep Learning Blog
Subscribe
Categories
- gpu-cloud (26)
- tutorials (24)
- benchmarks (22)
- announcements (20)
- NVIDIA H100 (13)
- lambda cloud (13)
- hardware (12)
- tensorflow (9)
- NVIDIA A100 (8)
- gpus (8)
- company (7)
- LLMs (6)
- deep learning (6)
- gpu clusters (6)
- hyperplane (6)
- news (6)
- training (6)
- CNNs (4)
- generative networks (4)
- presentation (4)
- research (4)
- rtx a6000 (4)
Recent posts
Benchmarks on NVIDIA’s Transformer Engine, which boosts FP8 performance by an impressive 60% on GPT3-style model testing on NVIDIA H100 Tensor Core GPUs.
Published 11/21/2023 by Chuan Li
GPU benchmarks on Lambda’s offering of the NVIDIA H100 SXM5 vs the NVIDIA A100 SXM4 using DeepChat’s 3-step training example.
Published 10/12/2023 by Chuan Li
...