Skip to content
This repository has been archived by the owner on Sep 18, 2024. It is now read-only.

Transformer Head Pruner #3884

Merged
merged 67 commits into from
Jul 28, 2021
Merged

Transformer Head Pruner #3884

merged 67 commits into from
Jul 28, 2021

Commits on Jun 29, 2021

  1. local code sync

    @xiaowu0162
    xiaowu0162 committed Jun 29, 2021
    Configuration menu
    Copy the full SHA
    1a1172c View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2021

  1. graph-based weight grouping

    @xiaowu0162
    xiaowu0162 committed Jun 30, 2021
    Configuration menu
    Copy the full SHA
    5f27c35 View commit details
    Browse the repository at this point in the history

  2. fix for pipeline

    @xiaowu0162
    xiaowu0162 committed Jun 30, 2021
    Configuration menu
    Copy the full SHA
    d960426 View commit details
    Browse the repository at this point in the history

  3. pipeline related

    @xiaowu0162
    xiaowu0162 committed Jun 30, 2021
    Configuration menu
    Copy the full SHA
    faedb0f View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2021

  1. add activation-based maskers; refactor example

    @xiaowu0162
    xiaowu0162 committed Jul 1, 2021
    Configuration menu
    Copy the full SHA
    c62b9a1 View commit details
    Browse the repository at this point in the history

  2. minor fix

    @xiaowu0162
    xiaowu0162 committed Jul 1, 2021
    Configuration menu
    Copy the full SHA
    6877b64 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2021

  1. change graph-based grouping logic

    @xiaowu0162
    xiaowu0162 committed Jul 2, 2021
    Configuration menu
    Copy the full SHA
    595864e View commit details
    Browse the repository at this point in the history

  2. remove redundant code

    @xiaowu0162
    xiaowu0162 committed Jul 2, 2021
    Configuration menu
    Copy the full SHA
    bd7ff9f View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2021

  1. Add taylor masker

    @xiaowu0162
    xiaowu0162 committed Jul 6, 2021
    Configuration menu
    Copy the full SHA
    b28725f View commit details
    Browse the repository at this point in the history

  2. debug

    @xiaowu0162
    xiaowu0162 committed Jul 6, 2021
    Configuration menu
    Copy the full SHA
    80bdf06 View commit details
    Browse the repository at this point in the history

  3. debug

    @xiaowu0162
    xiaowu0162 committed Jul 6, 2021
    Configuration menu
    Copy the full SHA
    d5582dd View commit details
    Browse the repository at this point in the history

  4. Add global sorting

    @xiaowu0162
    xiaowu0162 committed Jul 6, 2021
    Configuration menu
    Copy the full SHA
    0715a70 View commit details
    Browse the repository at this point in the history

  5. debug

    @xiaowu0162
    xiaowu0162 committed Jul 6, 2021
    Configuration menu
    Copy the full SHA
    d1e5d8d View commit details
    Browse the repository at this point in the history

  6. debug

    @xiaowu0162
    xiaowu0162 committed Jul 6, 2021
    Configuration menu
    Copy the full SHA
    aece26a View commit details
    Browse the repository at this point in the history

  7. Add iterative pruning

    @xiaowu0162
    xiaowu0162 committed Jul 6, 2021
    Configuration menu
    Copy the full SHA
    9cf94fe View commit details
    Browse the repository at this point in the history

  8. debug

    @xiaowu0162
    xiaowu0162 committed Jul 6, 2021
    Configuration menu
    Copy the full SHA
    7c73fc8 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2021

  1. Simplify API; add doc strings

    @xiaowu0162
    xiaowu0162 committed Jul 7, 2021
    Configuration menu
    Copy the full SHA
    79186e2 View commit details
    Browse the repository at this point in the history

  2. debug

    @xiaowu0162
    xiaowu0162 committed Jul 7, 2021
    Configuration menu
    Copy the full SHA
    690969a View commit details
    Browse the repository at this point in the history

  3. docstring

    @xiaowu0162
    xiaowu0162 committed Jul 7, 2021
    Configuration menu
    Copy the full SHA
    9d34493 View commit details
    Browse the repository at this point in the history

  4. example v1

    @xiaowu0162
    xiaowu0162 committed Jul 7, 2021
    Configuration menu
    Copy the full SHA
    1e2329e View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2021

  1. Merge branch 'microsoft:master' into bertpruner

    @xiaowu0162
    xiaowu0162 authored Jul 8, 2021
    Configuration menu
    Copy the full SHA
    7121051 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2021

  1. doc skeleton

    @xiaowu0162
    xiaowu0162 committed Jul 9, 2021
    Configuration menu
    Copy the full SHA
    94e4804 View commit details
    Browse the repository at this point in the history

  2. doc update

    @xiaowu0162
    xiaowu0162 committed Jul 9, 2021
    Configuration menu
    Copy the full SHA
    a5a92d9 View commit details
    Browse the repository at this point in the history

  3. doc update

    @xiaowu0162
    xiaowu0162 committed Jul 9, 2021
    Configuration menu
    Copy the full SHA
    5399dd8 View commit details
    Browse the repository at this point in the history

  4. doc update

    @xiaowu0162
    xiaowu0162 committed Jul 9, 2021
    Configuration menu
    Copy the full SHA
    ec5cdf2 View commit details
    Browse the repository at this point in the history

  5. doc update

    @xiaowu0162
    xiaowu0162 committed Jul 9, 2021
    Configuration menu
    Copy the full SHA
    f747a9a View commit details
    Browse the repository at this point in the history

  6. update

    @xiaowu0162
    xiaowu0162 committed Jul 9, 2021
    Configuration menu
    Copy the full SHA
    f70343c View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2021

  1. doc debug

    @xiaowu0162
    xiaowu0162 committed Jul 11, 2021
    Configuration menu
    Copy the full SHA
    e6b6d84 View commit details
    Browse the repository at this point in the history

  2. update examples

    @xiaowu0162
    xiaowu0162 committed Jul 11, 2021
    Configuration menu
    Copy the full SHA
    5aa63d2 View commit details
    Browse the repository at this point in the history

  3. debug

    @xiaowu0162
    xiaowu0162 committed Jul 11, 2021
    Configuration menu
    Copy the full SHA
    b0b01fc View commit details
    Browse the repository at this point in the history

  4. debug

    @xiaowu0162
    xiaowu0162 committed Jul 11, 2021
    Configuration menu
    Copy the full SHA
    af51872 View commit details
    Browse the repository at this point in the history

  5. debug

    @xiaowu0162
    xiaowu0162 committed Jul 11, 2021
    Configuration menu
    Copy the full SHA
    521b4c8 View commit details
    Browse the repository at this point in the history

  6. debug

    @xiaowu0162
    xiaowu0162 committed Jul 11, 2021
    Configuration menu
    Copy the full SHA
    42b3d5a View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2021

  1. fix ungrouped module removing logic

    @xiaowu0162
    xiaowu0162 committed Jul 16, 2021
    Configuration menu
    Copy the full SHA
    59b8adb View commit details
    Browse the repository at this point in the history

  2. Update shape dependency to align with master

    @xiaowu0162
    xiaowu0162 committed Jul 16, 2021
    Configuration menu
    Copy the full SHA
    af2144a View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into bertpruner

    @xiaowu0162
    xiaowu0162 authored Jul 16, 2021
    Configuration menu
    Copy the full SHA
    d8a11c2 View commit details
    Browse the repository at this point in the history

  4. doc string debug

    @xiaowu0162
    xiaowu0162 committed Jul 16, 2021
    Configuration menu
    Copy the full SHA
    3e446ed View commit details
    Browse the repository at this point in the history

  5. resolve comments

    @xiaowu0162
    xiaowu0162 committed Jul 16, 2021
    Configuration menu
    Copy the full SHA
    8fa6263 View commit details
    Browse the repository at this point in the history

  6. update docs

    @xiaowu0162
    xiaowu0162 committed Jul 16, 2021
    Configuration menu
    Copy the full SHA
    f45865f View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2021

  1. redo example

    @xiaowu0162
    xiaowu0162 committed Jul 18, 2021
    Configuration menu
    Copy the full SHA
    ec35267 View commit details
    Browse the repository at this point in the history

  2. docstring

    @xiaowu0162
    xiaowu0162 committed Jul 18, 2021
    Configuration menu
    Copy the full SHA
    b46bcee View commit details
    Browse the repository at this point in the history

  3. debug

    @xiaowu0162
    xiaowu0162 committed Jul 18, 2021
    Configuration menu
    Copy the full SHA
    8f83131 View commit details
    Browse the repository at this point in the history

  4. doc

    @xiaowu0162
    xiaowu0162 committed Jul 18, 2021
    Configuration menu
    Copy the full SHA
    941a301 View commit details
    Browse the repository at this point in the history

  5. debug

    @xiaowu0162
    xiaowu0162 committed Jul 18, 2021
    Configuration menu
    Copy the full SHA
    be5f38b View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2021

  1. debug

    @xiaowu0162
    xiaowu0162 committed Jul 19, 2021
    Configuration menu
    Copy the full SHA
    f193106 View commit details
    Browse the repository at this point in the history

  2. unit test

    @xiaowu0162
    xiaowu0162 committed Jul 19, 2021
    Configuration menu
    Copy the full SHA
    b9837e8 View commit details
    Browse the repository at this point in the history

  3. ut debug

    @xiaowu0162
    xiaowu0162 committed Jul 19, 2021
    Configuration menu
    Copy the full SHA
    53ab047 View commit details
    Browse the repository at this point in the history

  4. replace torch.linalg.norm with torch.norm

    @xiaowu0162
    xiaowu0162 committed Jul 19, 2021
    Configuration menu
    Copy the full SHA
    416f680 View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2021

  1. update ut

    @xiaowu0162
    xiaowu0162 committed Jul 20, 2021
    Configuration menu
    Copy the full SHA
    4d91a1e View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2021

  1. improve docs

    @xiaowu0162
    xiaowu0162 committed Jul 26, 2021
    Configuration menu
    Copy the full SHA
    c0efcd5 View commit details
    Browse the repository at this point in the history

  2. debug

    @xiaowu0162
    xiaowu0162 committed Jul 26, 2021
    Configuration menu
    Copy the full SHA
    bb8f437 View commit details
    Browse the repository at this point in the history

  3. example fix

    @xiaowu0162
    xiaowu0162 committed Jul 26, 2021
    Configuration menu
    Copy the full SHA
    61679f1 View commit details
    Browse the repository at this point in the history

  4. handle empty groups caused by config

    @xiaowu0162
    xiaowu0162 committed Jul 26, 2021
    Configuration menu
    Copy the full SHA
    c0b93ed View commit details
    Browse the repository at this point in the history

  5. sanity check

    @xiaowu0162
    xiaowu0162 committed Jul 26, 2021
    Configuration menu
    Copy the full SHA
    856ee2a View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2021

  1. head indexing

    @xiaowu0162
    xiaowu0162 committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    32bf76a View commit details
    Browse the repository at this point in the history

  2. default args

    @xiaowu0162
    xiaowu0162 committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    ed11f42 View commit details
    Browse the repository at this point in the history

  3. improve docs

    @xiaowu0162
    xiaowu0162 committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    50d9cb9 View commit details
    Browse the repository at this point in the history

  4. debug

    @xiaowu0162
    xiaowu0162 committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    a6727d5 View commit details
    Browse the repository at this point in the history

  5. debug

    @xiaowu0162
    xiaowu0162 committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    9411998 View commit details
    Browse the repository at this point in the history

  6. epoch parameter to trainer

    @xiaowu0162
    xiaowu0162 committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    ae31c18 View commit details
    Browse the repository at this point in the history

  7. update example

    @xiaowu0162
    xiaowu0162 committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    266ec1c View commit details
    Browse the repository at this point in the history

  8. Merge branch 'microsoft:master' into bertpruner

    @xiaowu0162
    xiaowu0162 authored Jul 27, 2021
    Configuration menu
    Copy the full SHA
    83cfd4a View commit details
    Browse the repository at this point in the history

  9. forward_runner API v1

    @xiaowu0162
    xiaowu0162 committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    a512ef3 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'bertpruner' of https://github.com/xiaowu0162/nni into b… 

    …ertpruner
    @xiaowu0162
    xiaowu0162 committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    5e5b962 View commit details
    Browse the repository at this point in the history

  11. delete some usages

    @xiaowu0162
    xiaowu0162 committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    00ad0ef View commit details
    Browse the repository at this point in the history

  12. update docs

    @xiaowu0162
    xiaowu0162 committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    a62f9de View commit details
    Browse the repository at this point in the history

  13. update ut

    @xiaowu0162
    xiaowu0162 committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    80383af View commit details
    Browse the repository at this point in the history