-
Notifications
You must be signed in to change notification settings - Fork 527
Requirements
embedding edited this page Feb 12, 2022
·
8 revisions
- Python >= 3.6
- torch >= 1.1
- six >= 1.12.0
- argparse
- packaging
- regex
- For the mixed precision training you will need apex from NVIDIA
- For the pre-trained model conversion (related with TensorFlow) you will need TensorFlow
- For the tokenization with sentencepiece model you will need SentencePiece
- For developing a stacking model you will need LightGBM and BayesianOptimization
- For the pre-training with whole word masking you will need word segmentation tool such as jieba
- For the use of CRF in sequence labeling downstream task you will need pytorch-crf
- For the gigantic model training you will need DeepSpeed