-
Notifications
You must be signed in to change notification settings - Fork 142
Requirements
zhezhaoa edited this page Nov 20, 2022
·
2 revisions
- Python >= 3.6
- torch >= 1.1
- six >= 1.12.0
- argparse
- packaging
- regex
- For the mixed precision training you will need apex from NVIDIA
- For the pre-trained model conversion (related with TensorFlow) you will need TensorFlow
- For the tokenization with sentencepiece model you will need SentencePiece
- For developing a stacking model you will need LightGBM and BayesianOptimization
- For the pre-training with whole word masking you will need word segmentation tool such as jieba
- For the use of CRF in sequence labeling downstream task you will need pytorch-crf
- For the gigantic model training you will need DeepSpeed
- For the vision model training you will need torchvision >= 0.9.0 (torch >= 1.8.0)
- For the audio model training you will need torchaudio