Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Mixtral multipack #928

Merged
merged 10 commits into from
Dec 10, 2023
Merged

Mixtral multipack #928

merged 10 commits into from
Dec 10, 2023

Commits on Dec 9, 2023

  1. mixtral multipack

    @winglian
    winglian committed Dec 9, 2023
    Configuration menu
    Copy the full SHA
    7624821 View commit details
    Browse the repository at this point in the history

  2. use mixtral model

    @winglian
    winglian committed Dec 9, 2023
    Configuration menu
    Copy the full SHA
    57d4bbc View commit details
    Browse the repository at this point in the history

  3. sample yml

    @winglian
    winglian committed Dec 9, 2023
    Configuration menu
    Copy the full SHA
    28230d1 View commit details
    Browse the repository at this point in the history

Commits on Dec 10, 2023

  1. calculate cu_seqlens properly

    @winglian
    winglian committed Dec 10, 2023
    Configuration menu
    Copy the full SHA
    855d3b0 View commit details
    Browse the repository at this point in the history

  2. use updated flash ettention setting

    @winglian
    winglian committed Dec 10, 2023
    Configuration menu
    Copy the full SHA
    8614c5a View commit details
    Browse the repository at this point in the history

  3. attn var checks

    @winglian
    winglian committed Dec 10, 2023
    Configuration menu
    Copy the full SHA
    83ee01f View commit details
    Browse the repository at this point in the history

  4. force use of flash attention 2 for packing

    @winglian
    winglian committed Dec 10, 2023
    Configuration menu
    Copy the full SHA
    f15f5e4 View commit details
    Browse the repository at this point in the history

  5. lint

    @winglian
    winglian committed Dec 10, 2023
    Configuration menu
    Copy the full SHA
    99d68c4 View commit details
    Browse the repository at this point in the history

  6. disable future fix for now

    @winglian
    winglian committed Dec 10, 2023
    Configuration menu
    Copy the full SHA
    8335e40 View commit details
    Browse the repository at this point in the history

  7. update support table

    @winglian
    winglian committed Dec 10, 2023
    Configuration menu
    Copy the full SHA
    76316e5 View commit details
    Browse the repository at this point in the history