Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

分布式训练在wandb之后卡住,但是单卡正常 #106

Open
chhhhh123 opened this issue Jul 11, 2024 · 0 comments
Open

分布式训练在wandb之后卡住,但是单卡正常 #106

chhhhh123 opened this issue Jul 11, 2024 · 0 comments

Comments

@chhhhh123
Copy link

wandb: Run wandb offline to turn off syncing.
wandb: Syncing run rsprompter_anchor-nwpu-peft-512
wandb: ⭐️ View project at https://wandb.ai/xxxxx/rsprompter-nwpu
wandb: 🚀 View run at https://wandb.ai/xxxx/rsprompter-nwpu/runs/xxxxx
之后卡住不动,但是单卡训练时候能正常运行

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant