Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

support for mamba #915

Merged
merged 15 commits into from
Dec 9, 2023
Merged

support for mamba #915

merged 15 commits into from
Dec 9, 2023

Commits on Dec 4, 2023

  1. support for mamba

    @winglian
    winglian committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    35a7e49 View commit details
    Browse the repository at this point in the history

  2. more mamba fixes

    @winglian
    winglian committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    af3a9dd View commit details
    Browse the repository at this point in the history

  3. use fork for mamba kwargs fix

    @winglian
    winglian committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    16998fd View commit details
    Browse the repository at this point in the history

  4. grad checkpointing doesn't work

    @winglian
    winglian committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    4b64292 View commit details
    Browse the repository at this point in the history

  5. fix extras for mamaba

    @winglian
    winglian committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    d90325c View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2023

  1. mamba loss fix

    @winglian
    winglian committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    28617fe View commit details
    Browse the repository at this point in the history

  2. use fp32 and remove verbose logging

    @winglian
    winglian committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    b7f34d6 View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2023

  1. mamba fixes

    @winglian
    winglian committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    4daa0bd View commit details
    Browse the repository at this point in the history

  2. fix collator for mamba

    @winglian
    winglian committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    54a207a View commit details
    Browse the repository at this point in the history

  3. set model_type on training_args

    @winglian
    winglian committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    563251a View commit details
    Browse the repository at this point in the history

  4. don't save safetensors for mamba

    @winglian
    winglian committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    cdc7b69 View commit details
    Browse the repository at this point in the history

Commits on Dec 9, 2023

  1. update mamba config to disable safetensor checkpooints, install for t… 

    …ests
    @winglian
    winglian committed Dec 9, 2023
    Configuration menu
    Copy the full SHA
    046cd3b View commit details
    Browse the repository at this point in the history

  2. no evals for mamba tests

    @winglian
    winglian committed Dec 9, 2023
    Configuration menu
    Copy the full SHA
    937d8e8 View commit details
    Browse the repository at this point in the history

  3. handle save_pretrained

    @winglian
    winglian committed Dec 9, 2023
    Configuration menu
    Copy the full SHA
    2df422e View commit details
    Browse the repository at this point in the history

  4. handle unused safetensors arg

    @winglian
    winglian committed Dec 9, 2023
    Configuration menu
    Copy the full SHA
    52d46b4 View commit details
    Browse the repository at this point in the history