The Lambda Deep Learning Blog

Featured Posts

Recent Posts

Unleashing the power of Transformers with NVIDIA Transformer Engine

Benchmarks on NVIDIA’s Transformer Engine, which boosts FP8 performance by an impressive 60% on GPT3-style model testing on NVIDIA H100 Tensor Core GPUs.

Published 11/21/2023 by Chuan Li

Lambda Cloud Clusters to support NVIDIA H200 Tensor Core GPUs

Lambda will be one of the first cloud providers in the world to offer customers access to NVIDIA H200 Tensor Core GPUs through Lambda Cloud Clusters.

Published 11/13/2023 by Maxx Garrison

Lambda Cloud Clusters now available with NVIDIA GH200 Grace Hopper Superchip

Lambda Cloud Clusters are now available with the NVIDIA GH200 Grace Hopper Superchip. A single GH200 has 576GB of coherent memory for unmatched efficiency.

Published 11/13/2023 by Maxx Garrison

DeepChat 3-Step Training At Scale: Lambda’s Instances of NVIDIA H100 SXM5 vs A100 SXM4

GPU benchmarks on Lambda’s offering of the NVIDIA H100 SXM5 vs the NVIDIA A100 SXM4 using DeepChat’s 3-step training example.

Published 10/12/2023 by Chuan Li

Persistent storage for Lambda Cloud is expanding!

Persistent storage for Lambda Cloud is expanding. Filesystems are now available for all regions except Utah, which is coming very soon.

Published 09/20/2023 by Kathy Bui

Exploring AI's Role in Summarizing Scientific Reviews

This analysis explores whether a Large Language Model, such as OpenAI's GPT, can assist in helping human readers digest scientific reviews.

Published 09/14/2023 by Xi Tian

Lambda Launches New Hyperplane Server with NVIDIA H100 GPUs and AMD EPYC 9004 series CPUs

Lambda has launched a new Hyperplane server combining the fastest GPU on the market, NVIDIA H100, with the world’s best data center CPU, AMD EPYC 9004.

Published 09/07/2023 by Maxx Garrison

How FlashAttention-2 Accelerates LLMs on NVIDIA H100 and A100 GPUs

How to use FlashAttention-2 on Lambda Cloud, including H100 vs A100 benchmark results for training GPT-3-style models using the new model.

Published 08/24/2023 by Chuan Li

Lambda Cloud Deploys On-Demand NVIDIA HGX H100 with 8x H100 SXM Instances

On-demand HGX H100 systems with 8x NVIDIA H100 SXM instances are now available on Lambda Cloud for only $2.59/hr/GPU.

Published 08/02/2023 by Kathy Bui

Chat with a PDF using Falcon: Unleashing the Power of Open-Source LLMs!

Unlock the potential of open-source LLMs by hosting your very own langchain+Falcon+Chroma application. Upload a PDF and engage in Q&A about its contents.

Published 07/24/2023 by Xi Tian

Fine tuning Meta's LLaMA 2 on Lambda GPU Cloud

This blog post provides instructions on how to fine tune LLaMA 2 models on Lambda Cloud using a $0.60/hr A10 GPU.

Published 07/20/2023 by Corey Lowman

Considerations for Large-Scale NVIDIA H100 Cluster Deployments

How to build the GPU infrastructure needed to pretrain LLM and Generative AI models from scratch (e.g. GPT-4, LaMDA, LLaMA, BLOOM).

Published 07/13/2023 by David Hall

Fine-tuning Falcon LLM 7B/40B

Learn how to fine-tune Falcon LLM 7B/40B on a single GPU with LoRA and quantization, enabling data parallelism for linear scaling across multiple GPUs.

Published 06/29/2023 by Xi Tian

...

Next page