Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Trainer(gradient_clip_algorithm='value'|'norm') #6123

Merged
merged 59 commits into from
Apr 6, 2021
Merged

Add Trainer(gradient_clip_algorithm='value'|'norm') #6123

merged 59 commits into from
Apr 6, 2021

Commits on Feb 22, 2021

  1. add changelog

    @dhkim0225
    dhkim0225 committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    09ea112 View commit details
    Browse the repository at this point in the history

  2. add clip by value

    @dhkim0225
    dhkim0225 committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    c0e8064 View commit details
    Browse the repository at this point in the history

  3. fix bug in training tricks.rst

    @dhkim0225
    dhkim0225 committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    ca8e6fd View commit details
    Browse the repository at this point in the history

  4. fix bug in trainer.rst

    @dhkim0225
    dhkim0225 committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    87f12c1 View commit details
    Browse the repository at this point in the history

  5. Update trainer.rst

    @dhkim0225
    dhkim0225 authored Feb 22, 2021
    Configuration menu
    Copy the full SHA
    8e43b8a View commit details
    Browse the repository at this point in the history

  6. Update trainer.rst

    @dhkim0225
    dhkim0225 authored Feb 22, 2021
    Configuration menu
    Copy the full SHA
    2bb9924 View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2021

  1. Update CHANGELOG.md 

    Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
    @dhkim0225 @Borda
    dhkim0225 and Borda authored Feb 23, 2021
    Configuration menu
    Copy the full SHA
    5b83f0d View commit details
    Browse the repository at this point in the history

  2. Update pytorch_lightning/plugins/precision/deepspeed_precision.py 

    Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
    @dhkim0225 @Borda
    dhkim0225 and Borda authored Feb 23, 2021
    Configuration menu
    Copy the full SHA
    caafdf2 View commit details
    Browse the repository at this point in the history

  3. Update pytorch_lightning/utilities/enums.py 

    Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
    @dhkim0225 @Borda
    dhkim0225 and Borda authored Feb 23, 2021
    Configuration menu
    Copy the full SHA
    ca774b6 View commit details
    Browse the repository at this point in the history

  4. yapf formatting

    @dhkim0225
    dhkim0225 committed Feb 23, 2021
    Configuration menu
    Copy the full SHA
    5a741e2 View commit details
    Browse the repository at this point in the history

  5. update training tricks

    @dhkim0225
    dhkim0225 committed Feb 23, 2021
    Configuration menu
    Copy the full SHA
    0568e3a View commit details
    Browse the repository at this point in the history

Commits on Feb 26, 2021

  1. Merge branch 'master' into feat/clip_grad_by_value

    @dhkim0225
    dhkim0225 authored Feb 26, 2021
    Configuration menu
    Copy the full SHA
    1a4e79e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into feat/clip_grad_by_value

    @tchaton
    tchaton authored Feb 26, 2021
    Configuration menu
    Copy the full SHA
    4a813c1 View commit details
    Browse the repository at this point in the history

Commits on Mar 2, 2021

  1. Merge branch 'master' into feat/clip_grad_by_value

    @dhkim0225
    dhkim0225 authored Mar 2, 2021
    Configuration menu
    Copy the full SHA
    2f5cb3e View commit details
    Browse the repository at this point in the history

  2. update based on comment

    @dhkim0225
    dhkim0225 committed Mar 2, 2021
    Configuration menu
    Copy the full SHA
    f4275a2 View commit details
    Browse the repository at this point in the history

  3. update based on comment

    @dhkim0225
    dhkim0225 committed Mar 2, 2021
    Configuration menu
    Copy the full SHA
    e92ec69 View commit details
    Browse the repository at this point in the history

  4. Update pytorch_lightning/trainer/trainer.py 

    Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
    @dhkim0225 @ananthsub
    dhkim0225 and ananthsub authored Mar 2, 2021
    Configuration menu
    Copy the full SHA
    ac701ce View commit details
    Browse the repository at this point in the history

  5. update based on comment

    @dhkim0225
    dhkim0225 committed Mar 2, 2021
    Configuration menu
    Copy the full SHA
    bc20fa4 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'feat/clip_grad_by_value' of https://github.com/dhkim022… 

    …5/pytorch-lightning into feat/clip_grad_by_value
    @dhkim0225
    dhkim0225 committed Mar 2, 2021
    Configuration menu
    Copy the full SHA
    b842210 View commit details
    Browse the repository at this point in the history

  7. pep8

    @dhkim0225
    dhkim0225 committed Mar 2, 2021
    Configuration menu
    Copy the full SHA
    5ec2ebd View commit details
    Browse the repository at this point in the history

  8. mypy

    @dhkim0225
    dhkim0225 committed Mar 2, 2021
    Configuration menu
    Copy the full SHA
    d37fbbc View commit details
    Browse the repository at this point in the history

  9. mypy

    @dhkim0225
    dhkim0225 committed Mar 2, 2021
    Configuration menu
    Copy the full SHA
    952c778 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'master' into feat/clip_grad_by_value

    @dhkim0225
    dhkim0225 authored Mar 2, 2021
    Configuration menu
    Copy the full SHA
    b8fdbe1 View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2021

  1. Merge branch 'master' into feat/clip_grad_by_value

    @dhkim0225
    dhkim0225 authored Mar 3, 2021
    Configuration menu
    Copy the full SHA
    c4cccf0 View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2021

  1. Update docs/source/advanced/training_tricks.rst 

    Co-authored-by: thomas chaton <thomas@grid.ai>
    @dhkim0225 @tchaton
    dhkim0225 and tchaton authored Mar 4, 2021
    Configuration menu
    Copy the full SHA
    6bd4793 View commit details
    Browse the repository at this point in the history

  2. Update sharded_native_amp.py

    @dhkim0225
    dhkim0225 authored Mar 4, 2021
    Configuration menu
    Copy the full SHA
    3aeba85 View commit details
    Browse the repository at this point in the history

  3. Update test_sharded_parity.py

    @dhkim0225
    dhkim0225 authored Mar 4, 2021
    Configuration menu
    Copy the full SHA
    902a33c View commit details
    Browse the repository at this point in the history

  4. update test codes

    @dhkim0225
    dhkim0225 committed Mar 4, 2021
    Configuration menu
    Copy the full SHA
    7467616 View commit details
    Browse the repository at this point in the history

  5. Update test_tpu.py

    @dhkim0225
    dhkim0225 authored Mar 4, 2021
    Configuration menu
    Copy the full SHA
    5463830 View commit details
    Browse the repository at this point in the history

  6. Update pytorch_lightning/trainer/connectors/training_trick_connector.py 

    Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
    @dhkim0225 @carmocca
    dhkim0225 and carmocca authored Mar 4, 2021
    Configuration menu
    Copy the full SHA
    2e933d4 View commit details
    Browse the repository at this point in the history

  7. Update test_trainer.py

    @dhkim0225
    dhkim0225 authored Mar 4, 2021
    Configuration menu
    Copy the full SHA
    b1e26e6 View commit details
    Browse the repository at this point in the history

  8. Update enums.py

    @dhkim0225
    dhkim0225 authored Mar 4, 2021
    Configuration menu
    Copy the full SHA
    cedf5f6 View commit details
    Browse the repository at this point in the history

  9. Update enums.py

    @dhkim0225
    dhkim0225 authored Mar 4, 2021
    Configuration menu
    Copy the full SHA
    f5bb45d View commit details
    Browse the repository at this point in the history

  10. Merge branch 'master' into feat/clip_grad_by_value

    @Borda
    Borda committed Mar 4, 2021
    Configuration menu
    Copy the full SHA
    42fc5f6 View commit details
    Browse the repository at this point in the history

Commits on Mar 5, 2021

  1. Merge branch 'master' into feat/clip_grad_by_value

    @dhkim0225
    dhkim0225 authored Mar 5, 2021
    Configuration menu
    Copy the full SHA
    e55b90c View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2021

  1. Merge branch 'master' into feat/clip_grad_by_value

    @carmocca
    carmocca authored Mar 23, 2021
    Configuration menu
    Copy the full SHA
    308ce38 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2021

  1. add super-class initialization to precision plugins.

    @dhkim0225
    dhkim0225 committed Mar 25, 2021
    Configuration menu
    Copy the full SHA
    903f2e2 View commit details
    Browse the repository at this point in the history

  2. add clip_grad horovod cpu test

    @dhkim0225
    dhkim0225 committed Mar 25, 2021
    Configuration menu
    Copy the full SHA
    28c948a View commit details
    Browse the repository at this point in the history

  3. add clip_grad horovod cpu test

    @dhkim0225
    dhkim0225 committed Mar 25, 2021
    Configuration menu
    Copy the full SHA
    177a1c9 View commit details
    Browse the repository at this point in the history

  4. use subprocess check_call

    @dhkim0225
    dhkim0225 committed Mar 25, 2021
    Configuration menu
    Copy the full SHA
    fc23845 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' of https://github.com/PyTorchLightning/pytorch-… 

    …lightning into feat/clip_grad_by_value
    @dhkim0225
    dhkim0225 committed Mar 25, 2021
    Configuration menu
    Copy the full SHA
    d99a650 View commit details
    Browse the repository at this point in the history

  6. change order of horovod tests

    @dhkim0225
    dhkim0225 committed Mar 25, 2021
    Configuration menu
    Copy the full SHA
    f80aa8d View commit details
    Browse the repository at this point in the history

  7. set max_epochs 2 in horovod test

    @dhkim0225
    dhkim0225 committed Mar 25, 2021
    Configuration menu
    Copy the full SHA
    fb895b6 View commit details
    Browse the repository at this point in the history

  8. remove clip_grad_val test from horovod-cpu

    @dhkim0225
    dhkim0225 committed Mar 25, 2021
    Configuration menu
    Copy the full SHA
    caa0bbf View commit details
    Browse the repository at this point in the history

  9. remove "type: ignore"

    @dhkim0225
    dhkim0225 committed Mar 25, 2021
    Configuration menu
    Copy the full SHA
    f1f9015 View commit details
    Browse the repository at this point in the history

  10. divide clip grad val test in horovod

    @dhkim0225
    dhkim0225 committed Mar 25, 2021
    Configuration menu
    Copy the full SHA
    5dfe5ef View commit details
    Browse the repository at this point in the history

  11. update based on comments

    @dhkim0225
    dhkim0225 committed Mar 25, 2021
    Configuration menu
    Copy the full SHA
    50a6c74 View commit details
    Browse the repository at this point in the history

  12. add super-class initialization to precision plugins.

    @dhkim0225
    dhkim0225 committed Mar 25, 2021
    Configuration menu
    Copy the full SHA
    c337b12 View commit details
    Browse the repository at this point in the history

  13. bugfix

    @dhkim0225
    dhkim0225 committed Mar 25, 2021
    Configuration menu
    Copy the full SHA
    f7a4fda View commit details
    Browse the repository at this point in the history

  14. bugfix

    @dhkim0225
    dhkim0225 committed Mar 25, 2021
    Configuration menu
    Copy the full SHA
    48c3dd8 View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2021

  1. revert some changes

    @dhkim0225
    dhkim0225 committed Mar 26, 2021
    Configuration menu
    Copy the full SHA
    e7e3b47 View commit details
    Browse the repository at this point in the history

  2. revert some changes

    @dhkim0225
    dhkim0225 committed Mar 26, 2021
    Configuration menu
    Copy the full SHA
    2997536 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' of https://github.com/PyTorchLightning/pytorch-… 

    …lightning into feat/clip_grad_by_value
    @dhkim0225
    dhkim0225 committed Mar 26, 2021
    Configuration menu
    Copy the full SHA
    fb34e84 View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2021

  1. Merge branch 'master' into feat/clip_grad_by_value

    @carmocca
    carmocca authored Mar 27, 2021
    Configuration menu
    Copy the full SHA
    8e665ec View commit details
    Browse the repository at this point in the history

  2. Update tests/models/test_horovod.py

    @carmocca
    carmocca authored Mar 27, 2021
    Configuration menu
    Copy the full SHA
    9575774 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2021

  1. Merge branch 'master' into feat/clip_grad_by_value

    @carmocca
    carmocca authored Mar 29, 2021
    Configuration menu
    Copy the full SHA
    7c16f6a View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2021

  1. merge master

    @dhkim0225
    dhkim0225 committed Apr 6, 2021
    Configuration menu
    Copy the full SHA
    fec189a View commit details
    Browse the repository at this point in the history

  2. merge master

    @dhkim0225
    dhkim0225 committed Apr 6, 2021
    Configuration menu
    Copy the full SHA
    1e80304 View commit details
    Browse the repository at this point in the history

  3. Delete signature test 

    No point in testing a signature
    @carmocca
    carmocca committed Apr 6, 2021
    Configuration menu
    Copy the full SHA
    4d5e05f View commit details
    Browse the repository at this point in the history