Home
Blog
GPU Benchmarks
Tutorials
Hardware
Cloud
Forum

multi-gpu

BERT Multi-GPU implementation using TensorFlow and Horovod with code

February 06, 2019

Slides for On-prem GPU Training Infrastructure for Deep Learning

Stephen Balaban

January 25, 2019

Page 1 of 1

Recent Post

NVIDIA NGC Tutorial: Run a PyTorch Docker Container using nvidia-container-toolkit on Ubuntu

Lambda raises $24.5M to build GPU cloud and deep learning hardware

Lambda Named NVIDIA Partner Network Solution Integration Provider of the Year

Subscribe to Lambda Blog

Browse by Topic

1080ti 3070 3080 3090 a100 about adversarial networks all reduce ampere announcements benchmarks BERT char-rnn cloud clusters CNNs company cuda data preparation deep dream deep learning distributed training docker drivers fun GANs generative networks GPT-2 GPT-3 gpu-cloud gpus hardware Horovod hpc hyperplane image classification ImageNet infiniband infrastructure keras lambda stack lambda-stack Language Model linux lstm machine learning mellanox multi-gpu nccl nccl2 networking neurips new-research news NLP nvidia-docker object detection openai papers performance presentation pytorch research rnn rtx 2080 ti rtx a6000 sgd software system administration tensorbook tensorflow teslav100 Test text generation titan v training tutorials ubuntu v100

About Lambda

Lambda is an AI infrastructure company, providing computation to accelerate human progress.

Lambda provides GPU workstations, servers, and cloud instances to some of the world’s leading AI researchers and engineers.

Click here to learn more about Lambda.

© 2021 Lambda. All right Reserved.

Search