Skip to content

BioBERT Large Results

Jinhyuk Lee edited this page Jan 21, 2020 · 6 revisions

These are the results of using BioBERT-Large v1.1 (+PubMed 1M). Improved results are in bold.

NER datasets (Precision/Recall/F1 score (%))

Dataset BioBERT-Base v1.1 (reported) BioBERT-Large v1.1
NCBI disease 88.22/91.25/89.71 87.70/89.90/88.79
BC4CHEMD 92.80/91.92/92.36 93.00/92.35/92.67
BC2GM 84.32/85.12/84.72 84.78/85.25/85.01

QA datasets (SAcc/LAcc/MRR (%))

Dataset BioBERT-Base v1.1 (reported) BioBERT-Large v1.1
BioASQ 4b 27.95/44.10/34.72 34.76/50.88/41.34
BioASQ 5b 46.00/60.00/51.64 46.66/60.38/52.12
BioASQ 6b 42.86/57.77/48.43 40.76/61.18/49.05
Clone this wiki locally