Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Deprecate max packed sequence len #1141

Merged
merged 6 commits into from
Jan 20, 2024
Merged

Deprecate max packed sequence len #1141

merged 6 commits into from
Jan 20, 2024

Commits on Jan 18, 2024

  1. deprecate max_packed_sequence_len, map and filter dataset during pre-… 

    …processing step
    @winglian
    winglian committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    fd954ce View commit details
    Browse the repository at this point in the history

  2. increase batch size for packed pretraining and be more robust on data… 

    … configs
    @winglian
    winglian committed Jan 18, 2024
    Configuration menu
    Copy the full SHA
    4a8392f View commit details
    Browse the repository at this point in the history

Commits on Jan 20, 2024

  1. deprecation tests

    @winglian
    winglian committed Jan 20, 2024
    Configuration menu
    Copy the full SHA
    585c11d View commit details
    Browse the repository at this point in the history

  2. normalize pretraining_dataset configuration

    @winglian
    winglian committed Jan 20, 2024
    Configuration menu
    Copy the full SHA
    a787d57 View commit details
    Browse the repository at this point in the history

  3. warn about not pre-processing

    @winglian
    winglian committed Jan 20, 2024
    Configuration menu
    Copy the full SHA
    334f02c View commit details
    Browse the repository at this point in the history

  4. log warning sooner if not pre-processed before training

    @winglian
    winglian committed Jan 20, 2024
    Configuration menu
    Copy the full SHA
    90d73fc View commit details
    Browse the repository at this point in the history