Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add GPTQ Quantization #1216

Merged
merged 57 commits into from
Aug 10, 2023
Merged

Add GPTQ Quantization #1216

merged 57 commits into from
Aug 10, 2023

Commits on Jul 12, 2023

  1. v1 test draft

    @younesbelkada
    younesbelkada committed Jul 12, 2023
    Configuration menu
    Copy the full SHA
    a1a33ef View commit details
    Browse the repository at this point in the history

  2. code runs but outputs gibberish.

    @younesbelkada
    younesbelkada committed Jul 12, 2023
    Configuration menu
    Copy the full SHA
    6ca0f12 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2023

  1. draft v1.1

    @SunMarc
    SunMarc committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    0fe030b View commit details
    Browse the repository at this point in the history

  2. remove duplicate

    @SunMarc
    SunMarc committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    71129bb View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2023

  1. remove dep to transformers and cleaning

    @SunMarc
    SunMarc committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    ac7023c View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2023

  1. Add serialization and loading

    @SunMarc
    SunMarc committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    4abb9b8 View commit details
    Browse the repository at this point in the history

  2. Clean code and doc

    @SunMarc
    SunMarc committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    7150a97 View commit details
    Browse the repository at this point in the history

  3. add flexibility

    @SunMarc
    SunMarc committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    2472804 View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2023

  1. remove triton

    @SunMarc
    SunMarc committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    88dbe0e View commit details
    Browse the repository at this point in the history

  2. remove some dep with transformers

    @SunMarc
    SunMarc committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    90ec342 View commit details
    Browse the repository at this point in the history

  3. add testing

    @SunMarc
    SunMarc committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    c7e49a0 View commit details
    Browse the repository at this point in the history

  4. make style

    @SunMarc
    SunMarc committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    110c8c1 View commit details
    Browse the repository at this point in the history

  5. add accelerate flag

    @SunMarc
    SunMarc committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    f64632f View commit details
    Browse the repository at this point in the history

  6. handle device placement

    @SunMarc
    SunMarc committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    ed9b743 View commit details
    Browse the repository at this point in the history

  7. make style

    @SunMarc
    SunMarc committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    f65a979 View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2023

  1. Apply suggestions 

    Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
Co-authored-by: fxmarty <9808326+fxmarty@users.noreply.github.com>
    @SunMarc @younesbelkada @fxmarty
    3 people committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    7720b36 View commit details
    Browse the repository at this point in the history

  2. add doc in data.py

    @SunMarc
    SunMarc committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    437329a View commit details
    Browse the repository at this point in the history

  3. apply suggestion for utils file

    @SunMarc
    SunMarc committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    cfe6239 View commit details
    Browse the repository at this point in the history

  4. remove multiple output

    @SunMarc
    SunMarc committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    3254d6e View commit details
    Browse the repository at this point in the history

  5. fix Optional

    @SunMarc
    SunMarc committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    939e4ab View commit details
    Browse the repository at this point in the history

  6. Apply suggestions from code review 

    Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
Co-authored-by: fxmarty <9808326+fxmarty@users.noreply.github.com>
    @SunMarc @younesbelkada @fxmarty
    3 people committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    e39f5b7 View commit details
    Browse the repository at this point in the history

  7. remove useless check

    @SunMarc
    SunMarc committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    f8a25e2 View commit details
    Browse the repository at this point in the history

  8. fix doc and style

    @SunMarc
    SunMarc committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    9afdbb4 View commit details
    Browse the repository at this point in the history

  9. fix name

    @SunMarc
    SunMarc committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    e404bde View commit details
    Browse the repository at this point in the history

  10. replace catcher by prefoward hook

    @SunMarc
    SunMarc committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    89d18d6 View commit details
    Browse the repository at this point in the history

  11. update doctstring for true_sequential

    @SunMarc
    SunMarc committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    7ac898a View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2023

  1. apply suggestion

    @SunMarc
    SunMarc committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    e34d960 View commit details
    Browse the repository at this point in the history

  2. Fix import

    @SunMarc
    SunMarc committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    d18226a View commit details
    Browse the repository at this point in the history

  3. Add docstring for tests

    @SunMarc
    SunMarc committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    754cd01 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. move args

    @SunMarc
    SunMarc committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    6d10f73 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2023

  1. fix typo

    @SunMarc
    SunMarc committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    bba3516 View commit details
    Browse the repository at this point in the history

  2. fix cpu offload and tokenizer

    @SunMarc
    SunMarc committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    e662240 View commit details
    Browse the repository at this point in the history

  3. fix typo

    @SunMarc
    SunMarc committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    58e3e7b View commit details
    Browse the repository at this point in the history

  4. fix offload cpu

    @SunMarc
    SunMarc committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    3633d43 View commit details
    Browse the repository at this point in the history

  5. modify attribute

    @SunMarc
    SunMarc committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    1df19a1 View commit details
    Browse the repository at this point in the history

  6. more explicit error

    @SunMarc
    SunMarc committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    28f4ce4 View commit details
    Browse the repository at this point in the history

  7. dataset optional

    @SunMarc
    SunMarc committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    a019885 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2023

  1. add tqdm bar instead

    @SunMarc
    SunMarc committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    d272099 View commit details
    Browse the repository at this point in the history

  2. style

    @SunMarc
    SunMarc committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    28acd3c View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2023

  1. add doc

    @SunMarc
    SunMarc committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    ae77ffa View commit details
    Browse the repository at this point in the history

  2. replace by tqdm.auto

    @SunMarc
    SunMarc committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    c745309 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'upstream/main' into add-gptq-marc

    @SunMarc
    SunMarc committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    98591ab View commit details
    Browse the repository at this point in the history

  4. change model

    @SunMarc
    SunMarc committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    088f56f View commit details
    Browse the repository at this point in the history

  5. add CI

    @SunMarc
    SunMarc committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    4b019ea View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2023

  1. Apply suggestions from code review 

    Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
    @SunMarc @younesbelkada
    SunMarc and younesbelkada committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    49362ac View commit details
    Browse the repository at this point in the history

  2. Update .github/workflows/test_gptq.yml 

    Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
    @SunMarc @younesbelkada
    SunMarc and younesbelkada committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    9de8918 View commit details
    Browse the repository at this point in the history

  3. add peft compatibility

    @SunMarc
    SunMarc committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    ba9b2c9 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. Apply suggestions from code review doc 

    Co-authored-by: fxmarty <9808326+fxmarty@users.noreply.github.com>
    @SunMarc @fxmarty
    SunMarc and fxmarty committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    e255ca9 View commit details
    Browse the repository at this point in the history

  2. merge examples

    @SunMarc
    SunMarc committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    b01bbfd View commit details
    Browse the repository at this point in the history

  3. code review

    @SunMarc
    SunMarc committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    62ac8bb View commit details
    Browse the repository at this point in the history

  4. fix test

    @SunMarc
    SunMarc committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    b0007fc View commit details
    Browse the repository at this point in the history

  5. make style

    @SunMarc
    SunMarc committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    19dff00 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2023

  1. change var

    @SunMarc
    SunMarc committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    15727f7 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2023

  1. fix doc

    @SunMarc
    SunMarc committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    c506947 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2023

  1. add exllama

    @SunMarc
    SunMarc committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    744c249 View commit details
    Browse the repository at this point in the history

  2. change naming

    @SunMarc
    SunMarc committed Aug 9, 2023
    Configuration menu
    Copy the full SHA
    66d7104 View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2023

  1. more doc

    @SunMarc
    SunMarc committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    b43d6e0 View commit details
    Browse the repository at this point in the history