Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Match "mul + where" as the pointwise operation before softmax in attention fusion #3381

Merged
merged 13 commits into from
Aug 20, 2024
Merged

Match "mul + where" as the pointwise operation before softmax in attention fusion #3381

merged 13 commits into from
Aug 20, 2024

Commits on Aug 14, 2024

  1. use random mode

    @umangyadav
    umangyadav committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    1a72979 View commit details
    Browse the repository at this point in the history

  2. use random mode by default

    @umangyadav
    umangyadav committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    4cf19be View commit details
    Browse the repository at this point in the history

  3. fix generate test

    @umangyadav
    umangyadav committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    7902ffb View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/develop' into change_mode

    @umangyadav
    umangyadav committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    800fc08 View commit details
    Browse the repository at this point in the history

  5. only use random when doing tuning

    @umangyadav
    umangyadav committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    d7a428a View commit details
    Browse the repository at this point in the history

  6. revert etst

    @umangyadav
    umangyadav committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    ae8fcfe View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2024

  1. add mul + where matcher for the attention

    @umangyadav
    umangyadav committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    2c9609e View commit details
    Browse the repository at this point in the history

  2. allow scalar

    @umangyadav
    umangyadav committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    357e547 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2024

  1. BUMP SHA to pull fix for where from rocMLIR

    @umangyadav
    umangyadav committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    1e6dd2b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' into fuse_where

    @umangyadav
    umangyadav committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    b74980f View commit details
    Browse the repository at this point in the history

  3. bump SHA

    @umangyadav
    umangyadav committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    5871ed5 View commit details
    Browse the repository at this point in the history

  4. fix licensing

    @umangyadav
    umangyadav committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    c82994c View commit details
    Browse the repository at this point in the history

  5. Merge branch 'develop' into fuse_where

    @umangyadav
    umangyadav committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    d872ea1 View commit details
    Browse the repository at this point in the history