Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document how to finetune pretrained model on downstream task #99

Merged
merged 3 commits into from
Dec 22, 2023

Conversation

weiji14
Copy link
Contributor

@weiji14 weiji14 commented Dec 22, 2023

Explaining how the pre-trained model can be finetuned after attaching a head to the network.

Opening this PR on behalf of @lillythomas who did the actual work and who wrote the original Jupyter notebook. The Jupyter Notebook has been converted to Markdown for easier visibilty on GitHub.

Screenshot:

image

Part of #90.

Explaining how the pre-trained model can be finetuned after attaching a head to the network. Written by Lilly.

Co-Authored-By: Lilly Thomas <lilly@developmentseed.org>
@weiji14 weiji14 added the documentation Improvements or additions to documentation label Dec 22, 2023
@weiji14 weiji14 removed their assignment Dec 22, 2023
@weiji14 weiji14 added this to the v0 Release milestone Dec 22, 2023
@weiji14 weiji14 marked this pull request as ready for review December 22, 2023 09:27
Co-Authored-By: Lilly Thomas <lilly@developmentseed.org>
@lillythomas
Copy link
Contributor

Oops I made one more typo:

"Here's a peak at the decoder layers:"

Peak should be peek

otherwise, feel free to merge when you're ready!

@weiji14
Copy link
Contributor Author

weiji14 commented Dec 22, 2023

Was a few seconds away from clicking that merge button. Good catch!

@weiji14 weiji14 merged commit ed55b5b into main Dec 22, 2023
2 checks passed
@weiji14 weiji14 deleted the docs/model_finetuning branch December 22, 2023 09:42
@weiji14 weiji14 changed the title Document how to finetune pretrained model on downstrem task Document how to finetune pretrained model on downstream task Dec 22, 2023
@weiji14
Copy link
Contributor Author

weiji14 commented Dec 22, 2023

Oops, there was typo in the PR title, oh well 😆

brunosan pushed a commit that referenced this pull request Dec 27, 2023
* 📝 Document how to finetune pretrained model on downstrem task

Explaining how the pre-trained model can be finetuned after attaching a head to the network. Written by Lilly.

---------

Co-authored-by: Lilly Thomas <lilly@developmentseed.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants