Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Extend save_pretrained to offloaded models #27412

Merged
merged 197 commits into from
Jun 7, 2024
Merged

Extend save_pretrained to offloaded models #27412

merged 197 commits into from
Jun 7, 2024

Commits on Jun 6, 2023

  1. added hidden subset

    @blbadger
    blbadger committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    e9c05dc View commit details
    Browse the repository at this point in the history

  2. Merge pull request #1 from blbadger/master 

    added hidden subset
    @blbadger
    blbadger committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    9c4b96a View commit details
    Browse the repository at this point in the history

  3. debugged hidden subset contrastive search

    @blbadger
    blbadger committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    fc52166 View commit details
    Browse the repository at this point in the history

  4. Merge pull request #2 from blbadger/master 

    debugged hidden subset contrastive search
    @blbadger
    blbadger committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    f16ac72 View commit details
    Browse the repository at this point in the history

  5. added contrastive search compression

    @blbadger
    blbadger committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    3906d60 View commit details
    Browse the repository at this point in the history

  6. Merge pull request #3 from blbadger/master 

    added contrastive search compression
    @blbadger
    blbadger committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    40ebe76 View commit details
    Browse the repository at this point in the history

  7. debugged compressed contrastive search

    @blbadger
    blbadger committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    2881aef View commit details
    Browse the repository at this point in the history

  8. Merge pull request #4 from blbadger/master 

    debugged compressed contrastive search
    @blbadger
    blbadger committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    4ddf45b View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2023

  1. memory reduction for contrastive search

    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    7d29c55 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #5 from blbadger/master 

    memory reduction for contrastive search
    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    b0b98cb View commit details
    Browse the repository at this point in the history

  3. debugged mem red

    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    57dfaac View commit details
    Browse the repository at this point in the history

  4. Merge pull request #6 from blbadger/master 

    debugged mem red
    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    a419245 View commit details
    Browse the repository at this point in the history

  5. added low memory option feature

    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    fd0e19f View commit details
    Browse the repository at this point in the history

  6. Merge pull request #7 from blbadger/master 

    added low memory option feature
    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    fc03ab2 View commit details
    Browse the repository at this point in the history

  7. debugged mem optmimization output stack

    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    802cfd4 View commit details
    Browse the repository at this point in the history

  8. debugged mem optmimization output stack

    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    0632f06 View commit details
    Browse the repository at this point in the history

  9. Merge pull request #8 from blbadger/master 

    Master
    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    8318968 View commit details
    Browse the repository at this point in the history

  10. debugged low mem

    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    9bad256 View commit details
    Browse the repository at this point in the history

  11. Merge pull request #9 from blbadger/master 

    debugged low mem
    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    8fa1731 View commit details
    Browse the repository at this point in the history

  12. added low mem cache

    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    a89bb8e View commit details
    Browse the repository at this point in the history

  13. Merge pull request #10 from blbadger/master 

    added low mem cache
    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    cdbd070 View commit details
    Browse the repository at this point in the history

  14. fixed 2047 tensor view

    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    f90f948 View commit details
    Browse the repository at this point in the history

  15. Merge pull request #11 from blbadger/master 

    fixed 2047 tensor view
    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    65feec9 View commit details
    Browse the repository at this point in the history

  16. debugged 2042 past key val inputs

    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    e1718c3 View commit details
    Browse the repository at this point in the history

  17. Merge pull request #12 from blbadger/master 

    debugged 2042 past key val inputs
    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    089a299 View commit details
    Browse the repository at this point in the history

  18. reformatted tensors

    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    3fd54e6 View commit details
    Browse the repository at this point in the history

  19. Merge pull request #13 from blbadger/master 

    reformatted tensors
    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    6d6ac75 View commit details
    Browse the repository at this point in the history

  20. changed low mem output

    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    12d5aea View commit details
    Browse the repository at this point in the history

  21. Merge pull request #14 from blbadger/master 

    changed low mem output
    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    89f9b13 View commit details
    Browse the repository at this point in the history

  22. final clean

    @blbadger
    blbadger committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    44a9ec4 View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2023

  1. removed subset hidden csearch

    @blbadger
    blbadger committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    37bb62d View commit details
    Browse the repository at this point in the history

  2. fixed hidden device

    @blbadger
    blbadger committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    68c1cd8 View commit details
    Browse the repository at this point in the history

  3. fixed hidden device

    @blbadger
    blbadger committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    e199ddc View commit details
    Browse the repository at this point in the history

  4. changed compressor dtype

    @blbadger
    blbadger committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    8ace5a3 View commit details
    Browse the repository at this point in the history

  5. removed hstate compression

    @blbadger
    blbadger committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    1ac80a0 View commit details
    Browse the repository at this point in the history

  6. integrated csearch in generate

    @blbadger
    blbadger committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    1c3aae7 View commit details
    Browse the repository at this point in the history

  7. test csearch integration into generation 

    exit()
    @blbadger
    blbadger committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    f18bccd View commit details
    Browse the repository at this point in the history

  8. fixed csearch kwarg integration with generation

    @blbadger
    blbadger committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    abf0a72 View commit details
    Browse the repository at this point in the history

  9. final wrap and added doc

    @blbadger
    blbadger committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    e517d5f View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2023

  1. Update src/transformers/generation/utils.py 

    Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
    @blbadger @gante
    blbadger and gante committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    cc1ea6d View commit details
    Browse the repository at this point in the history

  2. Update src/transformers/generation/utils.py 

    Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
    @blbadger @gante
    blbadger and gante committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    bd2e36b View commit details
    Browse the repository at this point in the history

  3. Update src/transformers/generation/utils.py 

    Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
    @blbadger @gante
    blbadger and gante committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    b59ec6d View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2023

  1. added debug print

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    a7fb76e View commit details
    Browse the repository at this point in the history

  2. direct hstate cat

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    961a1ba View commit details
    Browse the repository at this point in the history

  3. direct hstate cat

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    882b6d2 View commit details
    Browse the repository at this point in the history

  4. direct hstate cat debug

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    c3f3db3 View commit details
    Browse the repository at this point in the history

  5. direct hstate cat debug

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    692b5e1 View commit details
    Browse the repository at this point in the history

  6. expanded full hidden state stack

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    349bbf9 View commit details
    Browse the repository at this point in the history

  7. expanded full hidden state stack

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    cd4bed0 View commit details
    Browse the repository at this point in the history

  8. matched dims for hstates

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    ae41c50 View commit details
    Browse the repository at this point in the history

  9. matched dims for hstates

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    30baaa6 View commit details
    Browse the repository at this point in the history

  10. logits fix

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    ebc19ff View commit details
    Browse the repository at this point in the history

  11. equality test

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    752a488 View commit details
    Browse the repository at this point in the history

  12. equality hidden debug

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    4f973ba View commit details
    Browse the repository at this point in the history

  13. debug

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    b809415 View commit details
    Browse the repository at this point in the history

  14. added prints for debug

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    9230061 View commit details
    Browse the repository at this point in the history

  15. added prints for debug

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    2863471 View commit details
    Browse the repository at this point in the history

  16. equality check

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    e653353 View commit details
    Browse the repository at this point in the history

  17. switched squeeze dim

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    d790ea5 View commit details
    Browse the repository at this point in the history

  18. input format debug

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    f194221 View commit details
    Browse the repository at this point in the history

  19. tracing top_k_ids

    @blbadger
    blbadger committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    665c323 View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2023

  1. removed trace

    @blbadger
    blbadger committed Jun 17, 2023
    Configuration menu
    Copy the full SHA
    6259b56 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #16 from blbadger/equal-csearch 

    Equal csearch
    @blbadger
    blbadger committed Jun 17, 2023
    Configuration menu
    Copy the full SHA
    55561bb View commit details
    Browse the repository at this point in the history

  3. Merge branch 'huggingface:main' into main

    @blbadger
    blbadger committed Jun 17, 2023
    Configuration menu
    Copy the full SHA
    7f52d87 View commit details
    Browse the repository at this point in the history

  4. added test context

    @blbadger
    blbadger committed Jun 17, 2023
    Configuration menu
    Copy the full SHA
    6d2734c View commit details
    Browse the repository at this point in the history

  5. Merge pull request #17 from blbadger/equal-csearch 

    added test context
    @blbadger
    blbadger committed Jun 17, 2023
    Configuration menu
    Copy the full SHA
    a873dfd View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2023

  1. added jitter

    @blbadger
    blbadger committed Jun 18, 2023
    Configuration menu
    Copy the full SHA
    4033b19 View commit details
    Browse the repository at this point in the history

  2. added jitter

    @blbadger
    blbadger committed Jun 18, 2023
    Configuration menu
    Copy the full SHA
    e2051a7 View commit details
    Browse the repository at this point in the history

  3. added jitter

    @blbadger
    blbadger committed Jun 18, 2023
    Configuration menu
    Copy the full SHA
    e8f4cd1 View commit details
    Browse the repository at this point in the history

  4. returned state

    @blbadger
    blbadger committed Jun 18, 2023
    Configuration menu
    Copy the full SHA
    6bed197 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2023

  1. rebuilt past key value reconstruction

    @blbadger
    blbadger committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    67946f2 View commit details
    Browse the repository at this point in the history

  2. debugged

    @blbadger
    blbadger committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    3dbd776 View commit details
    Browse the repository at this point in the history

  3. cleaned traces

    @blbadger
    blbadger committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    547df69 View commit details
    Browse the repository at this point in the history

  4. added selection for pkv

    @blbadger
    blbadger committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    f4b1f28 View commit details
    Browse the repository at this point in the history

  5. changed output to dict

    @blbadger
    blbadger committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    d1af0f0 View commit details
    Browse the repository at this point in the history

  6. Merge pull request #18 from blbadger/selected-pkv 

    Selected pkv
    @blbadger
    blbadger committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    fbb11b5 View commit details
    Browse the repository at this point in the history

  7. cleaned

    @blbadger
    blbadger committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    ee94a31 View commit details
    Browse the repository at this point in the history

  8. cleaned

    @blbadger
    blbadger committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    5cfd454 View commit details
    Browse the repository at this point in the history

  9. Merge pull request #19 from blbadger/selected-pkv 

    Cleaned and formatted
    @blbadger
    blbadger committed Jun 21, 2023
    Configuration menu
    Copy the full SHA
    b63ec63 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2023

  1. cleaned up contrastive search test

    @blbadger
    blbadger committed Jun 22, 2023
    Configuration menu
    Copy the full SHA
    2fbca35 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #20 from blbadger/selected-pkv 

    cleaned up contrastive search test
    @blbadger
    blbadger committed Jun 22, 2023
    Configuration menu
    Copy the full SHA
    29b16f7 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2023

  1. moved low_memory kwarg

    @blbadger
    blbadger committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    efcba6f View commit details
    Browse the repository at this point in the history

  2. debugged

    @blbadger
    blbadger committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    5a3b26c View commit details
    Browse the repository at this point in the history

  3. Merge pull request #21 from blbadger/selected-pkv 

    Selected pkv
    @blbadger
    blbadger committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    fb337c3 View commit details
    Browse the repository at this point in the history

  4. changed low mem test batch size to 1

    @blbadger
    blbadger committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    cf12230 View commit details
    Browse the repository at this point in the history

  5. removed output

    @blbadger
    blbadger committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    60fd185 View commit details
    Browse the repository at this point in the history

  6. Merge pull request #22 from blbadger/selected-pkv 

    Selected pkv
    @blbadger
    blbadger committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    0e4fd99 View commit details
    Browse the repository at this point in the history

  7. debugged test input shape

    @blbadger
    blbadger committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    a3355c1 View commit details
    Browse the repository at this point in the history

  8. Merge pull request #23 from blbadger/selected-pkv 

    debugged test input shape
    @blbadger
    blbadger committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    704e9b1 View commit details
    Browse the repository at this point in the history

  9. reformatted csearch test

    @blbadger
    blbadger committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    87be0de View commit details
    Browse the repository at this point in the history

  10. Merge pull request #24 from blbadger/selected-pkv 

    reformatted csearch test
    @blbadger
    blbadger committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    8564437 View commit details
    Browse the repository at this point in the history

  11. added trace

    @blbadger
    blbadger committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    ab307f9 View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2023

  1. removed unsqueeze on final forward pass

    @blbadger
    blbadger committed Jul 4, 2023
    Configuration menu
    Copy the full SHA
    dfff73d View commit details
    Browse the repository at this point in the history

  2. replaced unsqueeze with view

    @blbadger
    blbadger committed Jul 4, 2023
    Configuration menu
    Copy the full SHA
    0334d12 View commit details
    Browse the repository at this point in the history

  3. removed traces

    @blbadger
    blbadger committed Jul 4, 2023
    Configuration menu
    Copy the full SHA
    06dacc0 View commit details
    Browse the repository at this point in the history

  4. cleaned

    @blbadger
    blbadger committed Jul 4, 2023
    Configuration menu
    Copy the full SHA
    94d6dd9 View commit details
    Browse the repository at this point in the history

  5. Merge pull request #25 from blbadger/selected-pkv 

    Cleaned and removed traces
    @blbadger
    blbadger committed Jul 4, 2023
    Configuration menu
    Copy the full SHA
    fe78f81 View commit details
    Browse the repository at this point in the history

  6. debugged model kwargs

    @blbadger
    blbadger committed Jul 4, 2023
    Configuration menu
    Copy the full SHA
    a2293dd View commit details
    Browse the repository at this point in the history

  7. Merge pull request #26 from blbadger/selected-pkv 

    debugged model kwargs
    @blbadger
    blbadger committed Jul 4, 2023
    Configuration menu
    Copy the full SHA
    150d1a1 View commit details
    Browse the repository at this point in the history

  8. removed special models from test

    @blbadger
    blbadger committed Jul 4, 2023
    Configuration menu
    Copy the full SHA
    0deba21 View commit details
    Browse the repository at this point in the history

  9. Merge pull request #27 from blbadger/selected-pkv 

    removed special models from test
    @blbadger
    blbadger committed Jul 4, 2023
    Configuration menu
    Copy the full SHA
    5237cf0 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'main' into main

    @blbadger
    blbadger committed Jul 4, 2023
    Configuration menu
    Copy the full SHA
    05c408e View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2023

  1. Merge branch 'huggingface:main' into main

    @blbadger
    blbadger committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    f9bd670 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2023

  1. ran make quality

    @blbadger
    blbadger committed Jul 7, 2023
    Configuration menu
    Copy the full SHA
    1aa7279 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'huggingface:main' into main

    @blbadger
    blbadger committed Jul 7, 2023
    Configuration menu
    Copy the full SHA
    8129e2a View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2023

  1. Update src/transformers/generation/configuration_utils.py 

    Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
    @blbadger @gante
    blbadger and gante committed Jul 8, 2023
    Configuration menu
    Copy the full SHA
    871cf59 View commit details
    Browse the repository at this point in the history

  2. Update src/transformers/generation/configuration_utils.py 

    Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
    @blbadger @gante
    blbadger and gante committed Jul 8, 2023
    Configuration menu
    Copy the full SHA
    ef6bfd6 View commit details
    Browse the repository at this point in the history

  3. refactored

    @blbadger
    blbadger committed Jul 8, 2023
    Configuration menu
    Copy the full SHA
    bad2d18 View commit details
    Browse the repository at this point in the history

  4. refactored

    @blbadger
    blbadger committed Jul 8, 2023
    Configuration menu
    Copy the full SHA
    f16f2e7 View commit details
    Browse the repository at this point in the history

  5. refactored

    @blbadger
    blbadger committed Jul 8, 2023
    Configuration menu
    Copy the full SHA
    af70bef View commit details
    Browse the repository at this point in the history

  6. Merge pull request #28 from blbadger/selected-pkv 

    Refactored
    @blbadger
    blbadger committed Jul 8, 2023
    Configuration menu
    Copy the full SHA
    d82e792 View commit details
    Browse the repository at this point in the history

  7. make fixup

    @blbadger
    blbadger committed Jul 8, 2023
    Configuration menu
    Copy the full SHA
    2d21e64 View commit details
    Browse the repository at this point in the history

  8. Merge pull request #29 from blbadger/selected-pkv 

    make fixup
    @blbadger
    blbadger committed Jul 8, 2023
    Configuration menu
    Copy the full SHA
    f310f83 View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2023

  1. renamed flag sequential

    @blbadger
    blbadger committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    bf3a073 View commit details
    Browse the repository at this point in the history

  2. renamed flag sequential

    @blbadger
    blbadger committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    b11c156 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #30 from blbadger/selected-pkv 

    Renamed low memory flag
    @blbadger
    blbadger committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    c619204 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'huggingface:main' into main

    @blbadger
    blbadger committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    1ae9d4a View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2023

  1. Merge branch 'huggingface:main' into main

    @blbadger
    blbadger committed Oct 14, 2023
    Configuration menu
    Copy the full SHA
    7d5e65f View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2023

  1. Merge branch 'huggingface:main' into main

    @blbadger
    blbadger committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    75d0f31 View commit details
    Browse the repository at this point in the history

  2. iterative onloading

    @blbadger
    blbadger committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    57e7336 View commit details
    Browse the repository at this point in the history

  3. black style and test utils

    @blbadger
    blbadger committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    fabd8fe View commit details
    Browse the repository at this point in the history

  4. added traces for integrated test

    @blbadger
    blbadger committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    3a4d088 View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2023

  1. debugged

    @blbadger
    blbadger committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    bcb5b66 View commit details
    Browse the repository at this point in the history

  2. added traces

    @blbadger
    blbadger committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    baf2c14 View commit details
    Browse the repository at this point in the history

  3. make style

    @blbadger
    blbadger committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    0639dee View commit details
    Browse the repository at this point in the history

  4. removed traces, make style

    @blbadger
    blbadger committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    9cdfa17 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2023

  1. included suggestions and added test

    @blbadger
    blbadger committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    9331741 View commit details
    Browse the repository at this point in the history

  2. debugged test

    @blbadger
    blbadger committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    f5166a7 View commit details
    Browse the repository at this point in the history

  3. added offload module check and make style

    @blbadger
    blbadger committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    40beac1 View commit details
    Browse the repository at this point in the history

  4. is_accelerate_available and make style

    @blbadger
    blbadger committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    f1d9335 View commit details
    Browse the repository at this point in the history

  5. added test decorator

    @blbadger
    blbadger committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    840cd58 View commit details
    Browse the repository at this point in the history

  6. changed test model and config spec

    @blbadger
    blbadger committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    931f3e4 View commit details
    Browse the repository at this point in the history

  7. added offload condition

    @blbadger
    blbadger committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    70755cb View commit details
    Browse the repository at this point in the history

Commits on Dec 3, 2023

  1. added lazy loading for each shard

    @blbadger
    blbadger committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    7d4c32e View commit details
    Browse the repository at this point in the history

  2. debugged

    @blbadger
    blbadger committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    dbc7830 View commit details
    Browse the repository at this point in the history

  3. modified sharding

    @blbadger
    blbadger committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    d569da0 View commit details
    Browse the repository at this point in the history

  4. debugged

    @blbadger
    blbadger committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    a33f25a View commit details
    Browse the repository at this point in the history

  5. added traces

    @blbadger
    blbadger committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    604b61c View commit details
    Browse the repository at this point in the history

  6. removed safe serialization

    @blbadger
    blbadger committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    016457f View commit details
    Browse the repository at this point in the history

  7. no index overload;

    @blbadger
    blbadger committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    de669bc View commit details
    Browse the repository at this point in the history

  8. trace on safe save ptrs

    @blbadger
    blbadger committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    9873ba5 View commit details
    Browse the repository at this point in the history

  9. added ptr condition

    @blbadger
    blbadger committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    dae9ef4 View commit details
    Browse the repository at this point in the history

  10. debugged

    @blbadger
    blbadger committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    56943d0 View commit details
    Browse the repository at this point in the history

  11. debugged ptr

    @blbadger
    blbadger committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    e595032 View commit details
    Browse the repository at this point in the history

  12. moved module map init

    @blbadger
    blbadger committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    aa4d143 View commit details
    Browse the repository at this point in the history

  13. remake shard only for offloaded modules

    @blbadger
    blbadger committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    e2a8267 View commit details
    Browse the repository at this point in the history

Commits on Dec 4, 2023

  1. refactored

    @blbadger
    blbadger committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    43e9c10 View commit details
    Browse the repository at this point in the history

  2. debugged

    @blbadger
    blbadger committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    1362730 View commit details
    Browse the repository at this point in the history

  3. refactored

    @blbadger
    blbadger committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    721b40e View commit details
    Browse the repository at this point in the history

  4. debugged

    @blbadger
    blbadger committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    50ab59a View commit details
    Browse the repository at this point in the history

  5. Merge pull request #31 from blbadger/lazy-sharder 

    Lazy onloading during shard saving
    @blbadger
    blbadger committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    60f465a View commit details
    Browse the repository at this point in the history

  6. cleaned and make style

    @blbadger
    blbadger committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    c87c998 View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2023

  1. Merge branch 'huggingface:main' into extended-save

    @blbadger
    blbadger committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    ef423c3 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'extended-save' of github.com:blbadger/transformers

    @blbadger
    blbadger committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    4be2a46 View commit details
    Browse the repository at this point in the history

  3. cleaned and make style

    @blbadger
    blbadger committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    3d38064 View commit details
    Browse the repository at this point in the history

  4. added trace

    @blbadger
    blbadger committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    d1bc156 View commit details
    Browse the repository at this point in the history

  5. sparse module map

    @blbadger
    blbadger committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    5822823 View commit details
    Browse the repository at this point in the history

  6. debugged

    @blbadger
    blbadger committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    f3f14e7 View commit details
    Browse the repository at this point in the history

  7. removed module map conditional

    @blbadger
    blbadger committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    01bc0d9 View commit details
    Browse the repository at this point in the history

  8. refactored

    @blbadger
    blbadger committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    a90e685 View commit details
    Browse the repository at this point in the history

  9. debug

    @blbadger
    blbadger committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    5c47e6e View commit details
    Browse the repository at this point in the history

  10. debugged

    @blbadger
    blbadger committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    05d3825 View commit details
    Browse the repository at this point in the history

  11. added traces

    @blbadger
    blbadger committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    2d88621 View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2023

  1. added shard mem trace

    @blbadger
    blbadger committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    3b907e4 View commit details
    Browse the repository at this point in the history

  2. added shard mem trace

    @blbadger
    blbadger committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    9058abd View commit details
    Browse the repository at this point in the history

  3. removed underlying storage check

    @blbadger
    blbadger committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    30067c3 View commit details
    Browse the repository at this point in the history

  4. refactored

    @blbadger
    blbadger committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    1ce0950 View commit details
    Browse the repository at this point in the history

  5. memory leak removal and make style

    @blbadger
    blbadger committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    9115fed View commit details
    Browse the repository at this point in the history

  6. cleaned

    @blbadger
    blbadger committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    76cc8cf View commit details
    Browse the repository at this point in the history

  7. Merge pull request #32 from blbadger/memory-test 

    Memory leak removed
    @blbadger
    blbadger committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    cd78228 View commit details
    Browse the repository at this point in the history

Commits on Jan 2, 2024

  1. swapped test decs and make style

    @blbadger
    blbadger committed Jan 2, 2024
    Configuration menu
    Copy the full SHA
    7f9725e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'huggingface:main' into extended-save

    @blbadger
    blbadger committed Jan 2, 2024
    Configuration menu
    Copy the full SHA
    4e8ac92 View commit details
    Browse the repository at this point in the history

Commits on Jan 13, 2024

  1. added mem checks and make style

    @blbadger
    blbadger committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    c5559c4 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'huggingface:main' into extended-save

    @blbadger
    blbadger committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    c85ff35 View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2024

  1. added free mem warning

    @blbadger
    blbadger committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    0d32451 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'huggingface:main' into extended-save

    @blbadger
    blbadger committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    df170e9 View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2024

  1. implemented some suggestions

    @blbadger
    blbadger committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    5ed37df View commit details
    Browse the repository at this point in the history

  2. moved onloading to accelerate

    @blbadger
    blbadger committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    061973a View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2024

  1. Merge branch 'main' into extended-save

    @blbadger
    blbadger committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    595dd26 View commit details
    Browse the repository at this point in the history

  2. refactored for accelerate integration

    @blbadger
    blbadger committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    3e58d2b View commit details
    Browse the repository at this point in the history

  3. cleaned test

    @blbadger
    blbadger committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    98b9fc8 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. make style

    @blbadger
    blbadger committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    3effcad View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2024

  1. debugged offload map name

    @blbadger
    blbadger committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    4379471 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2024

  1. cleaned and make style

    @blbadger
    blbadger committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    bdf508f View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2024

  1. replaced meta device check for sharding

    @blbadger
    blbadger committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    b568bdd View commit details
    Browse the repository at this point in the history

  2. cleaned and make style

    @blbadger
    blbadger committed Apr 19, 2024
    Configuration menu
    Copy the full SHA
    5a2b10e View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. Merge branch 'huggingface:main' into extended-save

    @blbadger
    blbadger committed May 30, 2024
    Configuration menu
    Copy the full SHA
    51dd1c2 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2024

  1. implemented some suggestions

    @blbadger
    blbadger committed May 31, 2024
    Configuration menu
    Copy the full SHA
    1074348 View commit details
    Browse the repository at this point in the history

  2. more suggestions

    @blbadger
    blbadger committed May 31, 2024
    Configuration menu
    Copy the full SHA
    38802a2 View commit details
    Browse the repository at this point in the history

  3. update warning 

    Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
    @blbadger @SunMarc
    blbadger and SunMarc committed May 31, 2024
    Configuration menu
    Copy the full SHA
    74967d8 View commit details
    Browse the repository at this point in the history

  4. more suggestions

    @blbadger
    blbadger committed May 31, 2024
    Configuration menu
    Copy the full SHA
    ec37d6d View commit details
    Browse the repository at this point in the history

  5. make style

    @blbadger
    blbadger committed May 31, 2024
    Configuration menu
    Copy the full SHA
    520b19e View commit details
    Browse the repository at this point in the history

  6. new make style

    @blbadger
    blbadger committed May 31, 2024
    Configuration menu
    Copy the full SHA
    7eaa268 View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2024

  1. Update src/transformers/modeling_utils.py 

    Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
    @blbadger @SunMarc
    blbadger and SunMarc committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    f3a4e30 View commit details
    Browse the repository at this point in the history

  2. Update src/transformers/modeling_utils.py 

    Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
    @blbadger @SunMarc
    blbadger and SunMarc committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    5a79199 View commit details
    Browse the repository at this point in the history

  3. Update src/transformers/modeling_utils.py 

    Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
    @blbadger @SunMarc
    blbadger and SunMarc committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    1946994 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. Update src/transformers/modeling_utils.py 

    Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
    @blbadger @amyeroberts
    blbadger and amyeroberts committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    0d22bdc View commit details
    Browse the repository at this point in the history