Skip to content
This repository has been archived by the owner on Oct 31, 2023. It is now read-only.

Performance drop with different val list order #146

Open
EternityDS opened this issue Dec 17, 2021 · 0 comments
Open

Performance drop with different val list order #146

EternityDS opened this issue Dec 17, 2021 · 0 comments

Comments

@EternityDS
Copy link

Hi authors,

Thanks for your great job! I have one quick question here.

I noticed that when training the votenet, the code sets shuffle=True for TEST_DATALOADER(which is very weird to me). That means every time for inference, we used the same val list in a different order.

I have thought it should be fine because we set net.eval(). However, the results actually performs very differently under the different order of val list. May I ask why this happened?

And also, if I get a very high result under one specific order of val list(but drop a lot under the original order of val list), can I report it as the final result?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant