fine tuning procedure. #37
Replies: 1 comment
-
Hello @Ngheissari, Let us know if this answers your questions and add any extra questions or comments you have |
Beta Was this translation helpful? Give feedback.
-
Hello @Ngheissari, Let us know if this answers your questions and add any extra questions or comments you have |
Beta Was this translation helpful? Give feedback.
-
Hi,
For fine tuning I often remove the top lawyer, add a small model on top of my model, freeze the base model , train the top model and then unfreeze the base model and retrain the whole thing.
In that way, large gradients of an untrained model wont mess up the pre trained model. Is that what is done here ? How the fine tuning procedure works ? I cannot see any additional layer or freezing /un freezing ... It seems that the whole thing is trained from scratch ?
Beta Was this translation helpful? Give feedback.
All reactions