Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What are the output files in OUTPUT_DIR after fine-tuning BioBERT for NER? #169

Open
sbi30 opened this issue Oct 25, 2021 · 1 comment
Open

Comments

@sbi30
Copy link

sbi30 commented Oct 25, 2021

After fine-tuning BioBERT and running in inference mode, I get some files in my specified OUTPUT_DIR such as .index, .data, .meta, .tf_record files, etc. What are these and what do they do?

I would like to load my fine-tuned model into a Jupyter notebook to run predictions on a new dataset. Which file is the fine-tuned model?

@wonjininfo
Copy link
Member

Hi!
Thank you for your interest in our work.
{.index, .data, .meta} files are a trained weights saved to the destination folder (OUTPUT_DIR).
.tf_record file is pre-processed data for train, dev, or test data.

If you want to load trained weights, use the file name without extensions as an initial checkpoint (--init_checkpoint=).
(For example, if you have model.ckpt-20000.data -> use --init_checkpoint=model.ckpt-20000. For other files such as config or vocab, you can use the original one. )

Also, please change OUTPUT_DIR to a new location!
Thank you!
Best,
Wonjin

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants