Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DDP: out of CUDA memory #20

Open
Iipython opened this issue Nov 27, 2021 · 0 comments
Open

DDP: out of CUDA memory #20

Iipython opened this issue Nov 27, 2021 · 0 comments

Comments

@Iipython
Copy link

image

我是用了5,6两张卡,发现多次报错 out of CUDA memory.
后来我发现两张卡上现存分布是不均衡的,导致一张卡很容易爆炸
KP2GB%J$RME))TT6W0{UN7Y
。请问原因可能是什么?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant