Sync metrics between all GPUs before logging when using DDP #3226
Labels
bug
Something isn't working
distributed
Generic distributed-related topic
duplicate
This issue or pull request already exists
help wanted
Open to be worked on
Milestone
Issue: When using DDP, tensorboard logger only logs for GPU0, which results in wrong overall metric shown in tensorboard.
The text was updated successfully, but these errors were encountered: