Skip to content

OpenNMT-py v3.5.0
Compare
Choose a tag to compare
@vince62s vince62s released this 22 Feb 17:42
· 15 commits to master since this release
v3.5.0
b9a60d6
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

3.5.0 (2024-02-22)

  • Further improvements and fixes
  • Suport for AWQ models
  • Add n_best for topp/topk generation
  • Support MoE (Mixtral) inference
  • Extend HF models converter
  • use flash_attn_with_kvcache for faster inference
  • Add wikitext2 PPL computation
  • Support for Phi-2 models
Assets 2
Loading