Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to reproduce the experimental results in the paper according to the default configuration file of the code. #5

Open
mingheyuemankong opened this issue Feb 22, 2023 · 7 comments

Comments

@mingheyuemankong
Copy link

I'm very sorry to bother you again! I think your work is excellent, but I want to seek the help of the author to solve my confusion.
According to the configuration file in the code, I can't reproduce the results in the paper. The indexes such as AP on the three datasets are lower than the experimental data in the paper. For example, the AP error on D2SA and KINS datasets reaches 4%-6%, and the error on COCOA cls is even larger.
What I want to ask are:
(1) The weights in the three datasets configuration files under the configs folder are all
WEIGHTS: "detectron2://ImageNetPretrained/MSRA/R-50.pkl"
Can training with this weight achieve the data results in the paper? If so, why is there a big gap between my reproduced results and the paper?
(2) If the author uses other weights to achieve such excellent data in the paper, can the author provide the weight link used?
I look forward to the author's valuable reply. @trqminh

@trqminh
Copy link
Contributor

trqminh commented Feb 25, 2023

Sorry for the late response, I see what is your concerning. I will update you as soon as I can.

@mingheyuemankong
Copy link
Author

Yay, thanks and looking forward to your brilliant answers!

@mingheyuemankong
Copy link
Author

Excuse me, is it still convenient to solve this problem about reproducing thesis data recently?

@trqminh
Copy link
Contributor

trqminh commented Mar 13, 2023

I am working on it, hope you can wait a bit more

@mingheyuemankong
Copy link
Author

Okay, thank you for your patient reply。

@lcl-git-3d
Copy link

Hi,have you solved this problem?

@mingheyuemankong
Copy link
Author

No, I didn't solve the problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants