DOM-LM - Pytorch (wip)

Unofficial implementation of Dom-LM paper.

Masked LM Training

Download SWDE
- Or: Download from torrent SWDE
Run preprocess_swde.py for features extraction
Run either train.py or train_mlm notebook

TODO

Add Fine-tuning code for Attribute Extraction
Add Fine-tuning code for Open Information Extraction
Add Fine-tuning code for QA
Train some models and compare results