Instructions for getting TensorFlow and PyTorch running on NVIDIA's GeForce RTX 30 Series GPUs (Ampere), including RTX 3090, RTX 3080, and RTX 3070.
This tutorial explains the basics of TensorFlow 2.0 with image classification as the example. 1) Data pipeline with dataset API. 2) Train, evaluate, save and restore models with Keras. 3) Multiple-GPU with distributed strategy. 4) Customized training with callbacks.
Distributed training allows scaling up deep learning tasks so bigger models can be learned from more extensive data. In this tutorial, we will explain how to do distributed training across multiple nodes.
This tutorial explains how early stopping is implemented in TensorFlow. The key lesson is to use tf.keras.EarlyStopping callback. Early stopping is triggered by monitoring if a certain quantity has improved over the latest period of time.
This tutorial explains how to use checkpoints to save and restore TensorFlow models during the training. The key is to use tf.kears.ModelCheckpoint callbacks to save the model. Set initial_epoch in the model.fit call to restore the model from a pre-saved checkpoint.
This tutorial explains how to do transfer learning with TensorFlow 2. We cover handling customized datasets, restoring backbone with Keras's application API, and restoring backbone from the disk.
RTX 2080 Ti vs. RTX 2080 vs. Titan RTX vs. Tesla V100 vs. Titan V vs. GTX 1080 Ti vs. Titan Xp benchmarks neural net training.
OpenAI recently published a blog post on their GPT-2 language model. This tutorial shows you how to run the text generator code yourself.
This tutorial is about making a character-based text generator using a simple two-layer LSTM. It will walk you through the data preparation and the network architecture. TensorFlow implementation is available at the end of the tutorial.
...