Single Node TensorFlow to Distributed DL

The notebook below follows our recommended development workflow. Before running the notebook, follow these steps to prepare your data:

  1. Prepare distributed data loading and model checkpointing.
  2. Prepare data for distributed training.
  3. Configure your FUSE_MOUNT_LOCATION in the notebook.

HorovodRunner TensorFlow MNIST Example