Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add FP8 TransformerEngine activation checkpointing #3156

Merged
merged 16 commits into from
Apr 9, 2024
Merged

Add FP8 TransformerEngine activation checkpointing #3156

merged 16 commits into from
Apr 9, 2024

Commits on Feb 7, 2024

  1. add te checkpoint wrapper

    @cli99
    cli99 committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    5bb341f View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2024

  1. Merge branch 'mosaicml:dev' into fp8-act-ckpt

    @cli99
    cli99 authored Feb 14, 2024
    Configuration menu
    Copy the full SHA
    ed6c304 View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2024

  1. remove extra wrapper

    @cli99
    cli99 committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    94ff68d View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2024

  1. Merge branch 'mosaicml:dev' into fp8-act-ckpt

    @cli99
    cli99 authored Feb 21, 2024
    Configuration menu
    Copy the full SHA
    81ec7db View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2024

  1. Merge branch 'mosaicml:dev' into fp8-act-ckpt

    @cli99
    cli99 authored Mar 7, 2024
    Configuration menu
    Copy the full SHA
    c961129 View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2024

  1. add option to shard fp8 weights

    @cli99
    cli99 committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    0995236 View commit details
    Browse the repository at this point in the history

  2. rename

    @cli99
    cli99 committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    67e6480 View commit details
    Browse the repository at this point in the history

  3. rename

    @cli99
    cli99 committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    7ebd9ce View commit details
    Browse the repository at this point in the history

Commits on Mar 11, 2024

  1. add log info

    @cli99
    cli99 committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    a9b8752 View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2024

  1. fix te checkpoint

    @cli99
    cli99 committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    237244a View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2024

  1. update with dev

    @cli99
    cli99 committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    ae7d1c6 View commit details
    Browse the repository at this point in the history

  2. update format

    @cli99
    cli99 committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    855c673 View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2024

  1. Merge branch 'dev' into fp8-act-ckpt

    @cli99
    cli99 authored Apr 1, 2024
    Configuration menu
    Copy the full SHA
    9e0b4bc View commit details
    Browse the repository at this point in the history

  2. add comment

    @cli99
    cli99 committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    94bcac9 View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2024

  1. Merge branch 'dev' into fp8-act-ckpt

    @j316chuck
    j316chuck authored Apr 3, 2024
    Configuration menu
    Copy the full SHA
    d4fdc7d View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2024

  1. Merge branch 'dev' into fp8-act-ckpt

    @dakinggg
    dakinggg authored Apr 5, 2024
    Configuration menu
    Copy the full SHA
    cbc9584 View commit details
    Browse the repository at this point in the history