Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

For the third factor of val_loader, the batch size value #11407

Closed
1 task done
ohjunee opened this issue Apr 21, 2023 · 2 comments
Closed
1 task done

For the third factor of val_loader, the batch size value #11407

ohjunee opened this issue Apr 21, 2023 · 2 comments
Labels
question Further information is requested Stale

Comments

@ohjunee
Copy link

ohjunee commented Apr 21, 2023

Search before asking

Question

image

I wonder why the third factor value is batch_size // WORLD_SIZE * 2.

Additional

No response

@ohjunee ohjunee added the question Further information is requested label Apr 21, 2023
@github-actions
Copy link
Contributor

👋 Hello there! We wanted to give you a friendly reminder that this issue has not had any recent activity and may be closed soon, but don't worry - you can always reopen it if needed. If you still have any questions or concerns, please feel free to let us know how we can help.

For additional resources and information, please see the links below:

Feel free to inform us of any other issues you discover or feature requests that come to mind in the future. Pull Requests (PRs) are also always welcomed!

Thank you for your contributions to YOLO 🚀 and Vision AI ⭐

@github-actions github-actions bot added the Stale label May 22, 2023
@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Jun 1, 2023
@glenn-jocher
Copy link
Member

@ohjunee hi there! The value "batch size // WORLD_SIZE * 2" for the third factor of val_loader is set to help distribute the workload across multiple GPUs using DDP (DistributedDataParallel). This formula balances the processing load for efficient multi-GPU training. If you have further questions or need more clarification, please feel free to ask!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested Stale
Projects
None yet
Development

No branches or pull requests

2 participants