Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Notes for the updates of the performance table #52

Open
taehoonlee opened this issue Nov 12, 2019 · 0 comments
Open

Notes for the updates of the performance table #52

taehoonlee opened this issue Nov 12, 2019 · 0 comments
Labels

Comments

@taehoonlee
Copy link
Owner

Recently, I have updated the performance table to follow the recent report format. I reviewed 10 recent papers as follows, and found that error rates and 10-crop testing are no longer used for evaluation after about 2017.

measure 10-crop
ResNeXt (CVPR 2017) err O
DenseNet (CVPR 2017) err O
PolyNet (CVPR 2017) err O
DPN (NIPS 2017) err -
SENet (CVPR 2018) err -
MobileNetV2 (CVPR 2018) acc -
NASNet (CVPR 2018) acc -
PNASNet (ECCV 2018) acc -
AmoebaNet (AAAI 2019) acc -
EfficientNet (ICML 2019) acc -

For the above reason, the recent commit replaces the top-k error rates with accuracies and removes the 10-5 column (the top-5 score with 10 crops).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant