Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add results to sotabench #39

Closed
Randl opened this issue Jun 11, 2020 · 3 comments
Closed

Add results to sotabench #39

Randl opened this issue Jun 11, 2020 · 3 comments
Labels
enhancement New feature or request

Comments

@Randl
Copy link

Randl commented Jun 11, 2020

馃殌 Feature

Add the model results on COCO to sotabench

Motivation

Sotabench is arguably the best independent model benchmark which allows to obtain fair comparison between models.

Pitch

What is required is to add sotabench.py to the repository. The website has both guides and code examples. Existing submissions can be used as a guideline too.

@Randl Randl added the enhancement New feature or request label Jun 11, 2020
@glenn-jocher
Copy link
Member

Hello, thank you for your interest in our work! We have noticed that this issue is very similar to one or more existing issues, and thus we are closing this as a duplicate issue. For help please see the following issue(s):

@glenn-jocher
Copy link
Member

@Randl I've created a sotabench.py file now in the root directory, which essentially a slight modification of the existing test.py file. sotabench.py defaults to testing YOLOv5s. I've registered the repo on sotabench.py, but something is not working correctly, as all builds get skipped. Any ideas why this might be happening?

Screen Shot 2020-09-03 at 1 26 41 AM

@glenn-jocher glenn-jocher reopened this Sep 3, 2020
@glenn-jocher
Copy link
Member

Closing as duplicate of #38

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants