-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Size inconsistency between pretrained_models and train_models. #2
Comments
Hi @GuoJeffrey, thanks for your interest in this work. This is quite a strange issue as the optimizer dimensions should match to that of the pretrained models i.e. to show the numbers on github we re-ran all of them based on checkpoints released in the model zoo. My current guess is that the size of the optimizer dictionaries differ now due to our final code clean up that separated a (previously) single optimizer instance into two for depth and pose for more control for users. In that case, the release pretrained checkpoints would be larger. Some questions:
|
Hello Prof. Wong, thanks for your reply! Pretrained_pose_models from Model Zoo: Train_pose_models training from scratch by myself: Answer to the questions:
|
Thanks for pasting the results. For loading the pretrained weights on your end, it seems like the code is able to reproduce some similar numbers and similarly for training so that is a good sign. For restoring the optimizer, I may need a few days to take a look at the optimizer parameters to see what is needed and what is not. After which I will re-upload the weights without the extra parameters. |
Thanks for Prof. Wong's response! @alexklwong. I wonder if it is convenient to load another pretrained models from Prof. Wong? I would appreciate it if possible. |
Dear Prof. Wong. Thanks for providing such wonderful project!
I encounted some problems when I tried to reproduce pretrained_models from scratch by myself.
I found that train_models (depth_model.pth is about 62.2 MB and pose_model.pth is about 48.2 MB) training by myself are smaller than pretrained_models (modi-kitti.pth is about 94.1 MB, posenet-kitti.pth is about 89.0 MB).
After analysing these models, I realized that the network frameworks are same in these models and the only difference between pretrained_models and train_models is "optimizer_state_dict" in models.
Pretrained_models from Model Zoo:
![2023-01-28 21-53-33屏幕截图](https://user-images.githubusercontent.com/37407481/215326824-855e29e7-dee9-47c0-8f61-8cad8dde6f28.png)
Train_models training from scratch by myself:
![2023-01-28 21-53-52屏幕截图](https://user-images.githubusercontent.com/37407481/215326974-27ee753b-dcac-45b3-b3ad-14e91c9a0055.png)
The training script is as follow:
training_script.txt
Could I trouble you to help me to understand the size inconsistency. I will appreciate any suggestions or tips on how to reproduce the pretrained_models.
Kind regards.
The text was updated successfully, but these errors were encountered: