Skip to content

Latest commit

 

History

History
 
 

nlp_seq

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
README.md
README.md
 
 
input_pipeline.py
input_pipeline.py
 
 
input_pipeline_test.py
input_pipeline_test.py
 
 
models.py
models.py
 
 
train.py
train.py
 
 

README.md

Part-of-Speech Tagging

Trains a simple sequence-based part-of-speech tagger. The following sentence shows an example.

From|ADP the|DT AP|PROPN comes|VBZ this|DT story|NN :|:

Requirements

  • Universal Dependency data sets: https://universaldependencies.org/#download.

    Download via command line:

    curl -# -o ud-treebanks-v2.0.tgz https://lindat.mff.cuni.cz/repository/xmlui/bitstream/handle/11234/1-1976/ud-treebanks-v2.0.tgz
tar xzf ud-treebanks-v2.0.tgz

Supported setups

The model should run with other configurations and hardware, but explicitly tested on the following.

Hardware Batch size Learning rate Training time Accuracy TensorBoard.dev
Nvidia V100 (16GB) 64 0.05 5h 15m 72.20% 2020-03-22

Running

python train.py --batch_size=64 --model_dir=./ancient_greek \
    --dev=ud-treebanks-v2.0/UD_Ancient_Greek/grc-ud-dev.conllu \
    --train=ud-treebanks-v2.0/UD_Ancient_Greek/grc-ud-train.conllu