Skip to content

v0.3.0

Compare
Choose a tag to compare
@jiahuei jiahuei released this 04 Jan 11:23
· 205 commits to main since this release

Main changes:

  • simplify forward method of all models
  • remove vocab_size + 1 and change default vocab_size from 10000 to 10001
  • cleanup train_*.py
  • update Config compat() function
  • refactor cached transformer base code
  • update transformer argparse argument names
  • remove --tokenizer_vocab_size argument
  • cleanup