Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problems of reproducing the Potsdam-3 dataset result #62

Open
pitlover opened this issue Dec 13, 2022 · 2 comments
Open

Problems of reproducing the Potsdam-3 dataset result #62

pitlover opened this issue Dec 13, 2022 · 2 comments

Comments

@pitlover
Copy link

Dear Mark,

According to the paper, it seems that the backbone of the model for Potsdam-3 dataset is vit-base, but there are no specific values for hyperparameters.
In addition, train_config.yml has a comment saying "Potsdam vit small 1/31/22", but the reproduced performance is only 61% which is lower than your report.

Can you share...

  1. the type of your backbone on Potsdam-3 (vit-base or vit-small)
  2. specific hyperparameters (weights and shifts for neg-inter, pos-inter, and pos-intra, respectively) for me, please?

Since Potsdam-3 dataset performance is very important to my work, I earnestly ask for your reply.

Thank you.

@pitlover pitlover changed the title Specific hyperparameters on Potsdam-3 dataset Problems of reproducing the Potsdam-3 dataset result Dec 16, 2022
@mhamilton723
Copy link
Owner

If you load our pretrained model you should able to reproduce those numbers. The pre-trained model also has the specific values of the hyperparameters used so that you can verify. Also the CRF adds a few points of perf in there too

@pitlover
Copy link
Author

Hi @mhamilton723 , could you provide a STEGO pretrained model(vit-base) on Cityscapes and Potsdam? Where can I get the weights?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants