Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Multipack simplify for Mixtral #1142

Merged
merged 8 commits into from
Jan 18, 2024
Merged

Multipack simplify for Mixtral #1142

merged 8 commits into from
Jan 18, 2024

Commits on Jan 18, 2024

  1. use existing mixtal with simpler unpad multipack logic

    @winglian
    winglian committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    77dff8d View commit details
    Browse the repository at this point in the history

  2. fix mistral check

    @winglian
    winglian committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    23d23c1 View commit details
    Browse the repository at this point in the history

  3. ensure cu_seqlens is on correct device and add logging

    @winglian
    winglian committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    bfc95f0 View commit details
    Browse the repository at this point in the history

  4. add validation for zero3 with flash attention

    @winglian
    winglian committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    e444919 View commit details
    Browse the repository at this point in the history

  5. chore: lint

    @winglian
    winglian committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    29c9f71 View commit details
    Browse the repository at this point in the history

  6. update smoke test for mixtral w multipack

    @winglian
    winglian committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    701052a View commit details
    Browse the repository at this point in the history

  7. fix test

    @winglian
    winglian committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    524b873 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'main' into multipack-simplify

    @winglian
    winglian authored Jan 18, 2024
    Configuration menu
    Copy the full SHA
    326c92f View commit details
    Browse the repository at this point in the history