description: Cross device communication implementation.

tf.distribute.experimental.CommunicationImplementation

View source on GitHub

Cross device communication implementation.

Warning: The alias tf.distribute.experimental.CollectiveCommunication is deprecated and will be removed in a future version. Use tf.distribute.experimental.CommunicationImplementation instead.

• AUTO: Automatically chosen by Tensorflow.
• RING: TensorFlow's ring algorithms for all-reduce and all-gather.
• NCCL: NVIDIA®'s NCCL library. This is now only used for all-reduce on GPUs; all-reduce on CPU, all-gather and broadcast fallbacks to RING.