You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, i read your code, and i have some questions, how the loss back propagate when using multiple gpus for extract task,here is your code:
Here, the loss back propagation is just the loss back propagation in a process, and the distributed module is not used to add the loss of each process running on different gpu, it's a little diferent from your code in abs task.
The text was updated successfully, but these errors were encountered:
Hi, i read your code, and i have some questions, how the loss back propagate when using multiple gpus for extract task,here is your code:
![image](https://user-images.githubusercontent.com/34132216/115137736-5d6f2d00-a05a-11eb-97e0-01aa10c03255.png)
Here, the loss back propagation is just the loss back propagation in a process, and the distributed module is not used to add the loss of each process running on different gpu, it's a little diferent from your code in abs task.
The text was updated successfully, but these errors were encountered: