How FlashAttention-2 Accelerates LLMs on NVIDIA H100 and A100 GPUs
This blog post walks you through how to use FlashAttention-2 on Lambda Cloud and outlines NVIDIA H100 vs NVIDIA A100 benchmark results for training GPT-3-style ...
Recent
NVIDIA GeForce RTX 4090 vs RTX 3090 Deep Learning Benchmark
Available October 2022, the NVIDIA® GeForce RTX 4090 is the newest GPU for gamers, creators, students, and researchers. In this post, we benchmark RTX 4090 to ...
All You Need Is One GPU: Inference Benchmark for Stable Diffusion
UPDATE 2022-Oct-13 (Turning off autocast for FP16 speeding inference up by 25%) What do I need for running the state-of-the-art text to image model? Can a ...
To top