The Lambda Deep Learning Blog

Featured Posts

Recent Posts

Multi-GPU enabled BERT using Horovod

BERT is Google's SOTA pre-training language representations. This blog is about running BERT with multiple GPUs. Specifically, we will use the Horovod framework to parrallelize the tasks. We ill list all the changes to the original BERT implementation and highlight a few places that will make or break the performance.

Published 02/06/2019 by Chuan Li

On-prem GPU Training Infrastructure for Deep Learning - Slides

You'll learn how to provide your team with GPU training infrastructure at a variety of scales, from a single shared multi-GPU system to a cluster for distributed training.

Published 01/25/2019 by Stephen Balaban

...

Next page