Learning Huggingface-Transformers

Unpacking the repo of Huggingface-Transformers.

Lesson 1: causal language model.

example/pytorch/language-modeling/run_clm_jl.py

Lesson 2: gpt2 model

src/transformers/models/gpt2/modeling_gpt2_jl.py

Lesson 3: Generation

src/transformers/generation/utils_jl.py

Lesson 4: Time Series Transformer

src/transformers/models/time_series_transformer/modeling_time_series_transformer_jl.py

Lesson 5: Tokenization

src/transformers/tokenization_utils.py

Lesson 6: Trainer

src/transformers/trainer_jl.py

src/transformers/trainer_jl.py