| .. role:: hidden | |
| :class: hidden-section | |
| Distributed Optimizers | |
| ====================== | |
| .. warning :: | |
| Distributed optimizer is not currently supported when using CUDA tensors | |
| .. automodule:: torch.distributed.optim | |
| :members: DistributedOptimizer, PostLocalSGDOptimizer, ZeroRedundancyOptimizer |