Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue with github api rate limiting #1890

Closed
iceisfun opened this issue Jan 10, 2021 · 3 comments · Fixed by #1894
Closed

Issue with github api rate limiting #1890

iceisfun opened this issue Jan 10, 2021 · 3 comments · Fixed by #1894
Labels
bug Something isn't working

Comments

@iceisfun
Copy link

iceisfun commented Jan 10, 2021

It seems that utils/google_utils.py has an issue in attempt_download after updating to the latest v4 stuff.

os.path.isfile is checked after calls to github, this ends up causing exceptions when a cluster of machines start making this api call and end up with rate limiting exceptions.

this function probably just needs to check if weights exists before making the api call.

# Don't download if we already have this file
if os.path.isfile(weights):
    return

before

response = requests.get('https://github.com/gitapi/repos/ultralytics/yolov5/releases/latest').json()  # github api

Keep up the good work on yolov5

@iceisfun iceisfun added the bug Something isn't working label Jan 10, 2021
@github-actions
Copy link
Contributor

github-actions bot commented Jan 10, 2021

👋 Hello @iceisfun, thank you for your interest in 🚀 YOLOv5! Please visit our ⭐️ Tutorials to get started, where you can find quickstart guides for simple tasks like Custom Data Training all the way to advanced concepts like Hyperparameter Evolution.

If this is a 🐛 Bug Report, please provide screenshots and minimum viable code to reproduce your issue, otherwise we can not help you.

If this is a custom training ❓ Question, please provide as much information as possible, including dataset images, training logs, screenshots, and a public link to online W&B logging if available.

For business inquiries or professional support requests please visit https://www.ultralytics.com or email Glenn Jocher at glenn.jocher@ultralytics.com.

Requirements

Python 3.8 or later with all requirements.txt dependencies installed, including torch>=1.7. To install run:

$ pip install -r requirements.txt

Environments

YOLOv5 may be run in any of the following up-to-date verified environments (with all dependencies including CUDA/CUDNN, Python and PyTorch preinstalled):

Status

CI CPU testing

If this badge is green, all YOLOv5 GitHub Actions Continuous Integration (CI) tests are currently passing. CI tests verify correct operation of YOLOv5 training (train.py), testing (test.py), inference (detect.py) and export (export.py) on MacOS, Windows, and Ubuntu every 24 hours and on every commit.

@glenn-jocher
Copy link
Member

@iceisfun good observation. I'd noticed intermitent CI failures since this the v4.0 release which includes this update, this is likely the reason. There is a .exists() check in the function, I suppose we simply need to move it to before the API call. I'll look into this.

@glenn-jocher
Copy link
Member

@iceisfun a fix for this has been implemented in PR #1894. Please git pull to receive this update and let us know if you spot any other issues!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants