Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sparsification Refactor for LLMs #1713

Merged
merged 31 commits into from
Oct 4, 2023
Merged

Sparsification Refactor for LLMs #1713

merged 31 commits into from
Oct 4, 2023

Commits on Sep 1, 2023

  1. Initial start implementation

    @markurtz
    markurtz committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    a3934c2 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2023

  1. add in further completion state for session and events

    @markurtz
    markurtz committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    d953be4 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2023

  1. add in recipe helper functions for merging, loading, and running call… 

    …backs
    @markurtz
    markurtz committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    42aef3d View commit details
    Browse the repository at this point in the history

  2. minor fixes for new framework

    @markurtz
    markurtz committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    6682784 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2023

  1. add constant pruning modifier

    @markurtz
    markurtz committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    5b0f190 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2023

  1. add magntitude pruning modifier

    @markurtz
    markurtz committed Sep 9, 2023
    Configuration menu
    Copy the full SHA
    b8452a5 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2023

  1. knowledge distillation implementation

    @markurtz
    markurtz committed Sep 10, 2023
    Configuration menu
    Copy the full SHA
    f04ca6f View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2023

  1. fix import errors and multiframework inits

    @Satrat
    Satrat committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    c745492 View commit details
    Browse the repository at this point in the history

  2. fix import errors and multiframework inits

    @Satrat @markurtz
    Satrat authored and markurtz committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    bc73e15 View commit details
    Browse the repository at this point in the history

  3. initialization

    @Satrat
    Satrat committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    5438e05 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2023

  1. RecipeModifiers working

    @Satrat
    Satrat committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    996c533 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2023

  1. fix import errors

    @markurtz
    markurtz committed Sep 17, 2023
    Configuration menu
    Copy the full SHA
    9635acb View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2023

  1. modifiers loading in stages

    @Satrat
    Satrat committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    7ecd5c6 View commit details
    Browse the repository at this point in the history

  2. adding test files

    @Satrat
    Satrat committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    3e2954e View commit details
    Browse the repository at this point in the history

  3. merge with base and update

    @Satrat
    Satrat committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    5eed10d View commit details
    Browse the repository at this point in the history

  4. modifier factory implementation

    @markurtz
    markurtz committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    6b83b02 View commit details
    Browse the repository at this point in the history

  5. running example, but sparsity not working correctly

    @Satrat
    Satrat committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    e857729 View commit details
    Browse the repository at this point in the history

  6. merge in factory, make it functional

    @Satrat
    Satrat committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    55eecc3 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2023

  1. fix polynomial scheduler, leave masks enabled on end

    @Satrat
    Satrat committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    bc5798d View commit details
    Browse the repository at this point in the history

  2. remove e2e files

    @Satrat
    Satrat committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    a35581d View commit details
    Browse the repository at this point in the history

  3. add on_event for modifier lifecycle and add initial integration for t… 

    …orchvision
    @markurtz
    markurtz committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    71869be View commit details
    Browse the repository at this point in the history

  4. leave_enabled fixes

    @Satrat
    Satrat committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    2d04ea0 View commit details
    Browse the repository at this point in the history

  5. fixing evals and finalization

    @Satrat
    Satrat committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    7b182e4 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2023

  1. Add test

    @rahul-tuli
    rahul-tuli committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    6c2255f View commit details
    Browse the repository at this point in the history

  2. Add changes to allow accepting strings

    @rahul-tuli
    rahul-tuli committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    abeedb7 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2023

  1. fix recipe staging issue

    @Satrat
    Satrat committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    571d21d View commit details
    Browse the repository at this point in the history

  2. style

    @Satrat
    Satrat committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    952e4ee View commit details
    Browse the repository at this point in the history

  3. style fixes

    @Satrat
    Satrat committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    ed8e0ba View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into sparsification-refactor

    @Satrat
    Satrat committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    7236de7 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2023

  1. bug fixes that came up during obcq implementation

    @Satrat
    Satrat committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    bfd7f84 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2023

  1. Merge branch 'main' into sparsification-refactor

    @bfineran
    bfineran committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    baf4b66 View commit details
    Browse the repository at this point in the history