Skip to content

Commit

Permalink
remove outdated info (#6032)
Browse files Browse the repository at this point in the history
  • Loading branch information
awaelchli authored Feb 17, 2021
1 parent a121fd3 commit 6a409c7
Showing 1 changed file with 0 additions and 2 deletions.
2 changes: 0 additions & 2 deletions docs/source/advanced/multi_gpu.rst
Original file line number Diff line number Diff line change
Expand Up @@ -298,8 +298,6 @@ Distributed Data Parallel

3. Each process inits the model.

.. note:: Make sure to set the random seed before the instantiation of a ``Trainer()`` so that each model initializes with the same weights.

4. Each process performs a full forward and backward pass in parallel.

5. The gradients are synced and averaged across all processes.
Expand Down

0 comments on commit 6a409c7

Please sign in to comment.