Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

bump transformers and update attention class map name #1023

Merged
merged 16 commits into from
Jan 3, 2024
Merged

bump transformers and update attention class map name #1023

merged 16 commits into from
Jan 3, 2024

Commits on Dec 30, 2023

  1. bump transformers and update attention class map name

    @winglian
    winglian committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    984ec2d View commit details
    Browse the repository at this point in the history

Commits on Dec 31, 2023

  1. also run the tests in docker

    @winglian
    winglian committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    387cdc9 View commit details
    Browse the repository at this point in the history

  2. add mixtral e2e smoke test

    @winglian
    winglian committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    a91badf View commit details
    Browse the repository at this point in the history

  3. fix base name for docker image in test

    @winglian
    winglian committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    2d46145 View commit details
    Browse the repository at this point in the history

  4. mixtral lora doesn't seem to work, at least check qlora

    @winglian
    winglian committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    b9a9b14 View commit details
    Browse the repository at this point in the history

Commits on Jan 1, 2024

  1. add testcase for mixtral w sample packing

    @winglian
    winglian committed Jan 1, 2024
    Configuration menu
    Copy the full SHA
    ff1277e View commit details
    Browse the repository at this point in the history

  2. check monkeypatch for flash attn multipack

    @winglian
    winglian committed Jan 1, 2024
    Configuration menu
    Copy the full SHA
    c5f108b View commit details
    Browse the repository at this point in the history

  3. also run the e2e tests in docker

    @winglian
    winglian committed Jan 1, 2024
    Configuration menu
    Copy the full SHA
    b9fcdbf View commit details
    Browse the repository at this point in the history

Commits on Jan 2, 2024

  1. use all gpus to run tests in docker ci

    @winglian
    winglian committed Jan 2, 2024
    Configuration menu
    Copy the full SHA
    99cbfb1 View commit details
    Browse the repository at this point in the history

  2. use privileged mode too for docker w gpus

    @winglian
    winglian committed Jan 2, 2024
    Configuration menu
    Copy the full SHA
    6882e7c View commit details
    Browse the repository at this point in the history

  3. rename the docker e2e actions for gh ci

    @winglian
    winglian committed Jan 2, 2024
    Configuration menu
    Copy the full SHA
    b4d47e0 View commit details
    Browse the repository at this point in the history

  4. set privileged mode for docker and update mixtral model self attn check

    @winglian
    winglian committed Jan 2, 2024
    Configuration menu
    Copy the full SHA
    44fa9ff View commit details
    Browse the repository at this point in the history

  5. use fp16/bf16 for mixtral w fa2

    @winglian
    winglian committed Jan 2, 2024
    Configuration menu
    Copy the full SHA
    658a660 View commit details
    Browse the repository at this point in the history

  6. skip e2e tests on docker w gpus for now

    @winglian
    winglian committed Jan 2, 2024
    Configuration menu
    Copy the full SHA
    2e23f38 View commit details
    Browse the repository at this point in the history

Commits on Jan 3, 2024

  1. tests to validate mistral and mixtral patches

    @winglian
    winglian committed Jan 3, 2024
    Configuration menu
    Copy the full SHA
    7a3f24b View commit details
    Browse the repository at this point in the history

  2. fix rel import

    @winglian
    winglian committed Jan 3, 2024
    Configuration menu
    Copy the full SHA
    e29b20f View commit details
    Browse the repository at this point in the history