Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Mistral] Add Flash Attention-2 support for mistral #26464

Merged
merged 28 commits into from
Oct 3, 2023
Merged

[Mistral] Add Flash Attention-2 support for mistral #26464

merged 28 commits into from
Oct 3, 2023

Commits on Sep 28, 2023

  1. add FA-2 support for mistral

    @younesbelkada
    younesbelkada committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    5d9bc48 View commit details
    Browse the repository at this point in the history

  2. fixup

    @younesbelkada
    younesbelkada committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    0983d88 View commit details
    Browse the repository at this point in the history

  3. add sliding windows

    @younesbelkada
    younesbelkada committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    b8c9198 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'add-mistral-fa-2' of https://github.com/younesbelkada/t… 

    …ransformers into add-mistral-fa-2
    @younesbelkada
    younesbelkada committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    d740849 View commit details
    Browse the repository at this point in the history

  5. fixing few nits

    @younesbelkada
    younesbelkada committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    bd58ca7 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2023

  1. v1 slicing cache - logits do not match

    @younesbelkada
    younesbelkada committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    43b0289 View commit details
    Browse the repository at this point in the history

  2. add comment

    @younesbelkada
    younesbelkada committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    ed2616f View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2023

  1. fix bugs

    @younesbelkada
    younesbelkada committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    7cafc2d View commit details
    Browse the repository at this point in the history

  2. more mem efficient

    @younesbelkada
    younesbelkada committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    2b8c7b4 View commit details
    Browse the repository at this point in the history

  3. add warning once

    @younesbelkada
    younesbelkada committed Oct 2, 2023
    1 Configuration menu
    Copy the full SHA
    4a3387d View commit details
    Browse the repository at this point in the history

  4. add warning once

    @younesbelkada
    younesbelkada committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    885b601 View commit details
    Browse the repository at this point in the history

  5. oops

    @younesbelkada
    younesbelkada committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    172d99a View commit details
    Browse the repository at this point in the history

  6. fixup

    @younesbelkada
    younesbelkada committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    253b383 View commit details
    Browse the repository at this point in the history

  7. more comments

    @younesbelkada
    younesbelkada committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    e4d0fb7 View commit details
    Browse the repository at this point in the history

  8. copy

    @younesbelkada
    younesbelkada committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    a245722 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'add-mistral-fa-2' of https://github.com/younesbelkada/t… 

    …ransformers into add-mistral-fa-2
    @younesbelkada
    younesbelkada committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    3079896 View commit details
    Browse the repository at this point in the history

  10. add safety checker

    @younesbelkada
    younesbelkada committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    e71c50d View commit details
    Browse the repository at this point in the history

  11. Merge branch 'add-mistral-fa-2' of https://github.com/younesbelkada/t… 

    …ransformers into add-mistral-fa-2
    @younesbelkada
    younesbelkada committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    a21d903 View commit details
    Browse the repository at this point in the history

  12. fixup

    @younesbelkada
    younesbelkada committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    5d1f589 View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2023

  1. Update src/transformers/models/mistral/modeling_mistral.py 

    Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
    @younesbelkada @ArthurZucker
    younesbelkada and ArthurZucker committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    b478e04 View commit details
    Browse the repository at this point in the history

  2. copied from

    @younesbelkada
    younesbelkada committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    2fe2f49 View commit details
    Browse the repository at this point in the history

  3. up

    @younesbelkada
    younesbelkada committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    25789d1 View commit details
    Browse the repository at this point in the history

  4. raise when padding side is right

    @younesbelkada
    younesbelkada committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    05ec7f4 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'add-mistral-fa-2' of https://github.com/younesbelkada/t… 

    …ransformers into add-mistral-fa-2
    @younesbelkada
    younesbelkada committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    5a79195 View commit details
    Browse the repository at this point in the history

  6. fixup

    @younesbelkada
    younesbelkada committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    f9a69bc View commit details
    Browse the repository at this point in the history

  7. add doc + few minor changes

    @younesbelkada
    younesbelkada committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    6a48dd3 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'add-mistral-fa-2' of https://github.com/younesbelkada/t… 

    …ransformers into add-mistral-fa-2
    @younesbelkada
    younesbelkada committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    76763c7 View commit details
    Browse the repository at this point in the history

  9. fixup

    @younesbelkada
    younesbelkada committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    c286946 View commit details
    Browse the repository at this point in the history