Skip to content

v0.6.0

Latest
Latest
Compare
Choose a tag to compare
@jiahuei jiahuei released this 01 Nov 05:20
· 80 commits to main since this release
v0.6.0
085ac3d
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Added support for Compact Transformers with:

  • Shared-QK, Shared-KV multi-head attention
  • Cross-layer sharing
Assets 2