Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(python): support PyTorch DDP compatible distributed training API #312

Merged
merged 140 commits into from
Nov 10, 2021

Conversation

shjwudp
Copy link
Member

@shjwudp shjwudp commented Oct 19, 2021

BREAKING CHANGE:

  • with_bagua not support partial process group input now.

@todo

This comment has been minimized.

@pr-triage pr-triage bot added the PR: draft label Oct 19, 2021
bagua/torch_api/ddp_compatible/ddp.py Outdated Show resolved Hide resolved
bagua/torch_api/ddp_compatible/ddp.py Outdated Show resolved Hide resolved
examples/benchmark/synthetic_benchmark_ddp_compatible.py Outdated Show resolved Hide resolved
bagua/torch_api/data_parallel/distributed.py Outdated Show resolved Hide resolved
bagua/torch_api/data_parallel/distributed.py Outdated Show resolved Hide resolved
bagua/torch_api/data_parallel/distributed.py Outdated Show resolved Hide resolved
tests/torch_api/test_broadcast_state.py Outdated Show resolved Hide resolved
bagua/torch_api/data_parallel/distributed.py Show resolved Hide resolved
bagua/torch_api/data_parallel/distributed.py Outdated Show resolved Hide resolved
bagua/torch_api/data_parallel/distributed.py Outdated Show resolved Hide resolved
bagua/torch_api/data_parallel/distributed.py Outdated Show resolved Hide resolved
bagua/torch_api/data_parallel/distributed.py Outdated Show resolved Hide resolved
tests/torch_api/data_parallel/test_broadcast_state.py Outdated Show resolved Hide resolved
NOBLES5E
NOBLES5E previously approved these changes Nov 10, 2021
@NOBLES5E NOBLES5E merged commit 0cd7405 into master Nov 10, 2021
@NOBLES5E NOBLES5E deleted the ddp_compatible branch November 10, 2021 08:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants