Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Modifier Refactor OBCQ Implementation #1737

Merged
merged 189 commits into from
Oct 11, 2023
Merged

Modifier Refactor OBCQ Implementation #1737

merged 189 commits into from
Oct 11, 2023

Commits on Aug 18, 2023

  1. First abstract structure with OPT, MPT

    @natuan
    natuan committed Aug 18, 2023
    Configuration menu
    Copy the full SHA
    bd729f3 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2023

  1. Merge branch 'main' into tuan/sparsegpt

    @Satrat
    Satrat committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    0476a14 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2023

  1. scaffolding

    @Satrat
    Satrat committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    e9c4e95 View commit details
    Browse the repository at this point in the history

  2. First abstract structure with OPT, MPT

    @natuan
    natuan committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    07a7273 View commit details
    Browse the repository at this point in the history

  3. Updated

    @natuan
    natuan committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    73ccd2e View commit details
    Browse the repository at this point in the history

  4. Updated

    @natuan
    natuan committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    f742f4a View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2023

  1. Initial implementation of Llama2 integration

    @anmarques
    anmarques committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    7c2d3d4 View commit details
    Browse the repository at this point in the history

  2. Initial implementation of Llama2 integration

    @anmarques
    anmarques committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    3f4c5d8 View commit details
    Browse the repository at this point in the history

  3. Fix llama-2 key

    @anmarques
    anmarques committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    c181380 View commit details
    Browse the repository at this point in the history

  4. Add modelutils

    @anmarques
    anmarques committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    dd0f5f8 View commit details
    Browse the repository at this point in the history

  5. Make smoothquant optional

    @anmarques
    anmarques committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    99f8bbe View commit details
    Browse the repository at this point in the history

  6. probe sequence length from model

    @anmarques
    anmarques committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    db901e4 View commit details
    Browse the repository at this point in the history

  7. probe sequence length from model

    @anmarques
    anmarques committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    48ebe81 View commit details
    Browse the repository at this point in the history

  8. Fix typo

    @anmarques
    anmarques committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    2be7def View commit details
    Browse the repository at this point in the history

  9. add in recipe and modifier logic

    @Satrat
    Satrat committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    fb346ad View commit details
    Browse the repository at this point in the history

  10. Catch additional arguments to load_model and load_data

    @anmarques
    anmarques committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    c4fc152 View commit details
    Browse the repository at this point in the history

  11. Redifinition of seqlen

    @anmarques
    anmarques committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    2b50607 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2023

  1. Runable OPT main code path

    @natuan
    natuan committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    15b2c10 View commit details
    Browse the repository at this point in the history

  2. mpt modifier

    @Satrat
    Satrat committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    34c3d84 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'tuan/sparsegpt' into sa/sgpt_modifier

    @Satrat
    Satrat committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    4cac803 View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2023

  1. Initial start implementation

    @markurtz
    markurtz committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    a3934c2 View commit details
    Browse the repository at this point in the history

  2. State before rebasing

    @anmarques
    anmarques committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    6a35b7f View commit details
    Browse the repository at this point in the history

  3. State before rebasing

    @anmarques
    anmarques committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    e02abb2 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/tuan/sparsegpt' into research/sp… 

    …arsegpt/llama2

# Conflicts:
#	src/sparseml/experimental/sparsegpt/dispatch.py
#	src/sparseml/experimental/sparsegpt/layer_compressor.py
#	src/sparseml/experimental/sparsegpt/main.py
#	src/sparseml/experimental/sparsegpt/model_preprocessor.py
#	src/sparseml/experimental/sparsegpt/opt.py
#	src/sparseml/experimental/sparsegpt/sequential.py
#	src/sparseml/experimental/sparsegpt/sparsegpt.py
    @anmarques
    anmarques committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    2fb9e66 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2023

  1. Initial support for MPT

    @natuan
    natuan committed Sep 4, 2023
    Configuration menu
    Copy the full SHA
    466213c View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2023

  1. add in further completion state for session and events

    @markurtz
    markurtz committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    d953be4 View commit details
    Browse the repository at this point in the history

  2. Initial commit for Llama2

    @natuan
    natuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    7fc49ac View commit details
    Browse the repository at this point in the history

  3. Return model after override Llama attn

    @natuan
    natuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    ff5b9a1 View commit details
    Browse the repository at this point in the history

  4. working refactor

    @Satrat
    Satrat committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    090af1c View commit details
    Browse the repository at this point in the history

  5. More memory-efficient layer compression

    @natuan
    natuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    594339f View commit details
    Browse the repository at this point in the history

  6. Make memory-efficient layer compressor default

    @natuan
    natuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    5750edf View commit details
    Browse the repository at this point in the history

  7. finalization, clean up file saving

    @Satrat
    Satrat committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    6c22fa1 View commit details
    Browse the repository at this point in the history

  8. SmoothQuant enabled

    @natuan
    natuan committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    f3f9119 View commit details
    Browse the repository at this point in the history

  9. support for quantization, clean up

    @Satrat
    Satrat committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    b2a6817 View commit details
    Browse the repository at this point in the history

  10. remove unsued files

    @Satrat
    Satrat committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    fa934c5 View commit details
    Browse the repository at this point in the history

  11. remove unsued files

    @Satrat
    Satrat committed Sep 5, 2023
    Configuration menu
    Copy the full SHA
    a0deb44 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2023

  1. add in recipe helper functions for merging, loading, and running call… 

    …backs
    @markurtz
    markurtz committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    42aef3d View commit details
    Browse the repository at this point in the history

  2. minor fixes for new framework

    @markurtz
    markurtz committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    6682784 View commit details
    Browse the repository at this point in the history

  3. move to transformers subdir

    @Satrat
    Satrat committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    59d1a72 View commit details
    Browse the repository at this point in the history

  4. quality

    @Satrat
    Satrat committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    96b9248 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into sa/sgpt_modifier

    @Satrat
    Satrat committed Sep 6, 2023
    Configuration menu
    Copy the full SHA
    c2471e1 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2023

  1. add constant pruning modifier

    @markurtz
    markurtz committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    5b0f190 View commit details
    Browse the repository at this point in the history

  2. fix modifier inheritance

    @Satrat
    Satrat committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    4e24413 View commit details
    Browse the repository at this point in the history

  3. PR comments, serialization

    @Satrat
    Satrat committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    836464d View commit details
    Browse the repository at this point in the history

  4. move compression to initializer

    @Satrat
    Satrat committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    4b511c9 View commit details
    Browse the repository at this point in the history

  5. clean up recipe

    @Satrat
    Satrat committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    39bfbbf View commit details
    Browse the repository at this point in the history

  6. Rebase

    @anmarques
    anmarques committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    aced1d8 View commit details
    Browse the repository at this point in the history

  7. Rebase

    @anmarques
    anmarques committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    6f3d188 View commit details
    Browse the repository at this point in the history

  8. Rebase

    @anmarques
    anmarques committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    ae6c2e2 View commit details
    Browse the repository at this point in the history

  9. Rebase

    @anmarques
    anmarques committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    ae2f8e0 View commit details
    Browse the repository at this point in the history

  10. Fix call to model eval

    @anmarques
    anmarques committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    b52e0b4 View commit details
    Browse the repository at this point in the history

  11. Fixes to caching

    @anmarques
    anmarques committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    3647653 View commit details
    Browse the repository at this point in the history

  12. Add support for llama2

    @anmarques
    anmarques committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    4652fcf View commit details
    Browse the repository at this point in the history

  13. Fix ptq-only option

    @anmarques
    anmarques committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    a81ba7b View commit details
    Browse the repository at this point in the history

  14. revert quant modifier

    @Satrat
    Satrat committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    f4f0a63 View commit details
    Browse the repository at this point in the history

  15. Fixes

    @anmarques
    anmarques committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    4e72fd6 View commit details
    Browse the repository at this point in the history

  16. Rebase

    @anmarques
    anmarques committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    751a5ac View commit details
    Browse the repository at this point in the history

  17. Rebase

    @anmarques
    anmarques committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    71e8473 View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2023

  1. Bugs fixed

    @natuan
    natuan committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    48dd147 View commit details
    Browse the repository at this point in the history

  2. Rebase

    @anmarques
    anmarques committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    924992c View commit details
    Browse the repository at this point in the history

  3. Rebase

    @anmarques
    anmarques committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    7b28a38 View commit details
    Browse the repository at this point in the history

  4. Rebase

    @anmarques
    anmarques committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    ebf00e8 View commit details
    Browse the repository at this point in the history

  5. Rebase

    @anmarques
    anmarques committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    4aa9e62 View commit details
    Browse the repository at this point in the history

  6. merge and move model loading to helper

    @Satrat
    Satrat committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    c19d386 View commit details
    Browse the repository at this point in the history

  7. Rebase

    @anmarques
    anmarques committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    6200f18 View commit details
    Browse the repository at this point in the history

  8. Rebase

    @anmarques
    anmarques committed Sep 8, 2023
    Configuration menu
    Copy the full SHA
    6444a94 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2023

  1. add magntitude pruning modifier

    @markurtz
    markurtz committed Sep 9, 2023
    Configuration menu
    Copy the full SHA
    b8452a5 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2023

  1. knowledge distillation implementation

    @markurtz
    markurtz committed Sep 10, 2023
    Configuration menu
    Copy the full SHA
    f04ca6f View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2023

  1. docstrings

    @Satrat
    Satrat committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    83b23f7 View commit details
    Browse the repository at this point in the history

  2. docstrings

    @Satrat
    Satrat committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    a32321c View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2023

  1. Rebase

    @anmarques
    anmarques committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    1bb260a View commit details
    Browse the repository at this point in the history

  2. Rebase

    @anmarques
    anmarques committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    2bb221f View commit details
    Browse the repository at this point in the history

  3. basic llama modifier(not fully tested)

    @Satrat
    Satrat committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    16cd0e5 View commit details
    Browse the repository at this point in the history

  4. working llama example

    @Satrat
    Satrat committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    8967b20 View commit details
    Browse the repository at this point in the history

  5. Evaluate model in eval mode

    @anmarques
    anmarques committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    bba4cbb View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2023

  1. rebase

    @anmarques
    anmarques committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    19f8610 View commit details
    Browse the repository at this point in the history

  2. remove evaluate model for opt

    @anmarques
    anmarques committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    e89c17f View commit details
    Browse the repository at this point in the history

  3. Fix model key for llama2

    @anmarques
    anmarques committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    3bd26e0 View commit details
    Browse the repository at this point in the history

  4. Fix model key for llama2

    @anmarques
    anmarques committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    9307286 View commit details
    Browse the repository at this point in the history

  5. Fix dataset loading

    @anmarques
    anmarques committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    daf66cf View commit details
    Browse the repository at this point in the history

  6. leave outputs as list

    @anmarques
    anmarques committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    d5f4b62 View commit details
    Browse the repository at this point in the history

  7. Clean up

    @anmarques
    anmarques committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    75539d5 View commit details
    Browse the repository at this point in the history

  8. Fixes for input data as list

    @anmarques
    anmarques committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    355f5c5 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2023

  1. fix import errors and multiframework inits

    @Satrat
    Satrat committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    c745492 View commit details
    Browse the repository at this point in the history

  2. fix import errors and multiframework inits

    @Satrat @markurtz
    Satrat authored and markurtz committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    bc73e15 View commit details
    Browse the repository at this point in the history

  3. initialization

    @Satrat
    Satrat committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    5438e05 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2023

  1. First abstract structure with OPT, MPT

    @natuan
    natuan committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    4d0fdc3 View commit details
    Browse the repository at this point in the history

  2. Updated

    @natuan
    natuan committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    0d00837 View commit details
    Browse the repository at this point in the history

  3. Updated

    @natuan
    natuan committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    e4a4878 View commit details
    Browse the repository at this point in the history

  4. Runable OPT main code path

    @natuan
    natuan committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    bb00c20 View commit details
    Browse the repository at this point in the history

  5. Initial support for MPT

    @natuan
    natuan committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    277ee89 View commit details
    Browse the repository at this point in the history

  6. Initial commit for Llama2

    @natuan
    natuan committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    b454e26 View commit details
    Browse the repository at this point in the history

  7. Return model after override Llama attn

    @natuan
    natuan committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    e459c92 View commit details
    Browse the repository at this point in the history

  8. More memory-efficient layer compression

    @natuan
    natuan committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    da511e9 View commit details
    Browse the repository at this point in the history

  9. Make memory-efficient layer compressor default

    @natuan
    natuan committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    42a2845 View commit details
    Browse the repository at this point in the history

  10. SmoothQuant enabled

    @natuan
    natuan committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    55ddec5 View commit details
    Browse the repository at this point in the history

  11. Bugs fixed

    @natuan
    natuan committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    aaa68a1 View commit details
    Browse the repository at this point in the history

  12. Make load data more flexible

    @natuan
    natuan committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    cbc9360 View commit details
    Browse the repository at this point in the history

  13. Initialize scales in eval mode; clean up

    @natuan
    natuan committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    f48cef6 View commit details
    Browse the repository at this point in the history

  14. Example script and recipe for OPT

    @natuan
    natuan committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    80f9208 View commit details
    Browse the repository at this point in the history

  15. Formatting

    @natuan
    natuan committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    e61dc21 View commit details
    Browse the repository at this point in the history

  16. Copyright

    @natuan
    natuan committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    dff49e3 View commit details
    Browse the repository at this point in the history

  17. Fix code styles

    @natuan
    natuan committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    c63001d View commit details
    Browse the repository at this point in the history

  18. Format

    @natuan
    natuan committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    bd213a5 View commit details
    Browse the repository at this point in the history

  19. Fixes for channelwise quantization

    @anmarques
    anmarques committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    32cf3c9 View commit details
    Browse the repository at this point in the history

  20. Name fixes

    @anmarques
    anmarques committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    c2afba0 View commit details
    Browse the repository at this point in the history

  21. RecipeModifiers working

    @Satrat
    Satrat committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    996c533 View commit details
    Browse the repository at this point in the history

  22. Merge branch 'tuan/sparsegpt' into sa/sgpt_modifier

    @Satrat
    Satrat committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    aacdd54 View commit details
    Browse the repository at this point in the history

  23. Merge branch 'sa/llama_modifiers' into sa/sgpt_modifier

    @Satrat
    Satrat committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    4dab25c View commit details
    Browse the repository at this point in the history

  24. remove unused buffer

    @anmarques
    anmarques committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    5ae7a87 View commit details
    Browse the repository at this point in the history

  25. Support for smoothquant

    @anmarques
    anmarques committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    ef9da3a View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2023

  1. fix import errors

    @markurtz
    markurtz committed Sep 17, 2023
    Configuration menu
    Copy the full SHA
    9635acb View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2023

  1. Reformat smoothquant dict

    @anmarques
    anmarques committed Sep 18, 2023
    Configuration menu
    Copy the full SHA
    5845359 View commit details
    Browse the repository at this point in the history

  2. Push smoothquant to a separate file

    @anmarques
    anmarques committed Sep 18, 2023
    Configuration menu
    Copy the full SHA
    e3166d0 View commit details
    Browse the repository at this point in the history

  3. perplexity evaluation for opt

    @Satrat
    Satrat committed Sep 18, 2023
    Configuration menu
    Copy the full SHA
    8e797c5 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2023

  1. modifiers loading in stages

    @Satrat
    Satrat committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    7ecd5c6 View commit details
    Browse the repository at this point in the history

  2. adding test files

    @Satrat
    Satrat committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    3e2954e View commit details
    Browse the repository at this point in the history

  3. merge with base and update

    @Satrat
    Satrat committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    5eed10d View commit details
    Browse the repository at this point in the history

  4. Rebase

    @anmarques
    anmarques committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    0807ba6 View commit details
    Browse the repository at this point in the history

  5. Rebase

    @anmarques
    anmarques committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    3137424 View commit details
    Browse the repository at this point in the history

  6. Add support to logarithmic activation equalization

    @anmarques
    anmarques committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    72f1d33 View commit details
    Browse the repository at this point in the history

  7. Add support to logarithmic activation equalization

    @anmarques
    anmarques committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    69bb017 View commit details
    Browse the repository at this point in the history

  8. Add support to logarithmic activation equalization

    @anmarques
    anmarques committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    7a08733 View commit details
    Browse the repository at this point in the history

  9. Fix counter

    @anmarques
    anmarques committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    69494db View commit details
    Browse the repository at this point in the history

  10. Rebase

    @anmarques
    anmarques committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    b4fccfb View commit details
    Browse the repository at this point in the history

  11. Rebase

    @anmarques
    anmarques committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    ad9d7ea View commit details
    Browse the repository at this point in the history

  12. Rebase

    @anmarques
    anmarques committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    4bcf07b View commit details
    Browse the repository at this point in the history

  13. Rebase

    @anmarques
    anmarques committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    a981621 View commit details
    Browse the repository at this point in the history

  14. Add license message

    @anmarques
    anmarques committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    5d9bbfb View commit details
    Browse the repository at this point in the history

  15. modifier factory implementation

    @markurtz
    markurtz committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    6b83b02 View commit details
    Browse the repository at this point in the history

  16. running example, but sparsity not working correctly

    @Satrat
    Satrat committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    e857729 View commit details
    Browse the repository at this point in the history

  17. Account for when keys are not matched

    @anmarques
    anmarques committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    b134431 View commit details
    Browse the repository at this point in the history

  18. Expand caching to include inputs. Move main ppl logic to utils

    @anmarques
    anmarques committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    55027ce View commit details
    Browse the repository at this point in the history

  19. Expand caching to include inputs. Move main ppl logic to utils

    @anmarques
    anmarques committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    925fa61 View commit details
    Browse the repository at this point in the history

  20. Update opt integration

    @anmarques
    anmarques committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    e88aa5d View commit details
    Browse the repository at this point in the history

  21. merge in factory, make it functional

    @Satrat
    Satrat committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    55eecc3 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2023

  1. fix polynomial scheduler, leave masks enabled on end

    @Satrat
    Satrat committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    bc5798d View commit details
    Browse the repository at this point in the history

  2. remove e2e files

    @Satrat
    Satrat committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    a35581d View commit details
    Browse the repository at this point in the history

  3. add on_event for modifier lifecycle and add initial integration for t… 

    …orchvision
    @markurtz
    markurtz committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    71869be View commit details
    Browse the repository at this point in the history

  4. leave_enabled fixes

    @Satrat
    Satrat committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    2d04ea0 View commit details
    Browse the repository at this point in the history

  5. fixing evals and finalization

    @Satrat
    Satrat committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    7b182e4 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2023

  1. rebasing research and cleaning up perplexity

    @Satrat
    Satrat committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    031c539 View commit details
    Browse the repository at this point in the history

  2. remove local files

    @Satrat
    Satrat committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    ddf35be View commit details
    Browse the repository at this point in the history

  3. style and base obcq modifier

    @Satrat
    Satrat committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    4e3fd35 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'sa/sgpt_modifier' into refactor_obcq

    @Satrat
    Satrat committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    4c34fae View commit details
    Browse the repository at this point in the history

  5. [untested] convert obcq to new framework

    @Satrat
    Satrat committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    8015028 View commit details
    Browse the repository at this point in the history

  6. obcq working

    @Satrat
    Satrat committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    727928f View commit details
    Browse the repository at this point in the history

  7. Add test

    @rahul-tuli
    rahul-tuli committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    6c2255f View commit details
    Browse the repository at this point in the history

  8. Add changes to allow accepting strings

    @rahul-tuli
    rahul-tuli committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    abeedb7 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2023

  1. update llama example recipe

    @Satrat
    Satrat committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    c7848e5 View commit details
    Browse the repository at this point in the history

  2. fix recipe staging issue

    @Satrat
    Satrat committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    571d21d View commit details
    Browse the repository at this point in the history

  3. style

    @Satrat
    Satrat committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    952e4ee View commit details
    Browse the repository at this point in the history

  4. style fixes

    @Satrat
    Satrat committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    ed8e0ba View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into sparsification-refactor

    @Satrat
    Satrat committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    7236de7 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2023

  1. reorg file structure

    @Satrat
    Satrat committed Sep 25, 2023
    Configuration menu
    Copy the full SHA
    42a235b View commit details
    Browse the repository at this point in the history

  2. quant modifier in new framework, opt tested

    @Satrat
    Satrat committed Sep 25, 2023
    Configuration menu
    Copy the full SHA
    ef0ef18 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'sparsification-refactor' into refactor_obcq

    @Satrat
    Satrat committed Sep 25, 2023
    Configuration menu
    Copy the full SHA
    4d1c716 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2023

  1. Removing custom smoothquant from this branch

    @anmarques
    anmarques committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    8887b61 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into research/sparsegpt/llama2

    @anmarques
    anmarques committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    4597497 View commit details
    Browse the repository at this point in the history

  3. post one shot calibration, recipe update

    @Satrat
    Satrat committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    a1d15c8 View commit details
    Browse the repository at this point in the history

  4. bug fixes that came up during obcq implementation

    @Satrat
    Satrat committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    bfd7f84 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'sparsification-refactor' into refactor_obcq

    @Satrat
    Satrat committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    05e0efb View commit details
    Browse the repository at this point in the history

  6. moving obcq script

    @Satrat
    Satrat committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    be06113 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2023

  1. quant fix, prunen and m

    @Satrat
    Satrat committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    629f9c5 View commit details
    Browse the repository at this point in the history

  2. fix experimental import paths, add comparison test

    @Satrat
    Satrat committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    13ac2b9 View commit details
    Browse the repository at this point in the history

  3. return perplexity

    @Satrat
    Satrat committed Sep 27, 2023
    Configuration menu
    Copy the full SHA
    0cadcf3 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2023

  1. Merge branch 'research/sparsegpt/llama2' into refactor_obcq

    @Satrat
    Satrat committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    76a8391 View commit details
    Browse the repository at this point in the history

  2. style

    @Satrat
    Satrat committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    d9e969c View commit details
    Browse the repository at this point in the history

  3. specify compressible layers in recipe

    @Satrat
    Satrat committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    eec247d View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2023

  1. move attention cache to base class

    @Satrat
    Satrat committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    5a985d0 View commit details
    Browse the repository at this point in the history

  2. move attention cache to base class

    @Satrat
    Satrat committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    bae96af View commit details
    Browse the repository at this point in the history

  3. clean up test scripts

    @Satrat
    Satrat committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    6067521 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2023

  1. clean up bottom compressors and comments

    @Satrat
    Satrat committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    27ba629 View commit details
    Browse the repository at this point in the history

  2. documentation

    @Satrat
    Satrat committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    0bdee59 View commit details
    Browse the repository at this point in the history

  3. fix typos

    @Satrat
    Satrat committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    ac29d68 View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2023

  1. PR comments

    @Satrat
    Satrat committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    7617f9c View commit details
    Browse the repository at this point in the history

  2. small bug fix on logger

    @Satrat
    Satrat committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    f216d53 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into refactor_obcq

    @Satrat
    Satrat committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    dcbbbd4 View commit details
    Browse the repository at this point in the history

  4. fixing transformer dependency, adding registry for dataset loaders

    @Satrat
    Satrat committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    de3dc2f View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2023

  1. fixing bugs in dataset loading and perplexity

    @Satrat
    Satrat committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    39ff676 View commit details
    Browse the repository at this point in the history

  2. cleanup

    @Satrat
    Satrat committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    7423f20 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into refactor_obcq

    @Satrat
    Satrat committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    25ba312 View commit details
    Browse the repository at this point in the history

  4. fix memory issue in comparison

    @Satrat
    Satrat committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    13c3a6c View commit details
    Browse the repository at this point in the history

  5. return perplexity

    @Satrat
    Satrat committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    b5e9d6d View commit details
    Browse the repository at this point in the history

  6. adding split to all datasets

    @Satrat
    Satrat committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    1decfe5 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'refactor_obcq' of https://github.com/neuralmagic/sparseml… 

    … into refactor_obcq
    @Satrat
    Satrat committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    0a0cff9 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2023

  1. Update src/sparseml/modifiers/obcq/base.py 

    Co-authored-by: Benjamin Fineran <bfineran@users.noreply.github.com>
    @Satrat @bfineran
    Satrat and bfineran committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    5fa7361 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into refactor_obcq

    @Satrat
    Satrat committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    f1441cb View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2023

  1. fixing dataset issues

    @Satrat
    Satrat committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    29271a3 View commit details
    Browse the repository at this point in the history