How FlashAttention-2 Accelerates LLMs on NVIDIA H100 and A100 GPUs
This blog post walks you through how to use FlashAttention-2 on Lambda Cloud and outlines NVIDIA H100 vs NVIDIA A100 benchmark results for training GPT-3-style ...
Recent
Voltron Data Case Study: Why ML teams are using Lambda Reserved Cloud Clusters
One of the biggest trends in machine learning is the development of large transformer models like BERT and diffusion models like stable diffusion. These large ...
Tesla A100 Server Total Cost of Ownership Analysis
This post compares the Total Cost of Ownership (TCO) for Lambda servers and clusters vs cloud instances with NVIDIA A100 GPUs. We first calculate the TCO for ...
To top