Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updated streaming args for StreamingDataset subclasses #602

Merged
merged 4 commits into from
Sep 16, 2023

Commits on Sep 15, 2023

  1. Fix streaming dataset setup for fine-tuning

    Currently, when a StreamingFinetuningDataset is created using the
    build_finetuning_dataloader method, a failure is returned as some
    incorrect parameters are passed through to the constructor of
    StreamingFinetuningDataset. This patch fixes the paramter mismatch and
    adds test coverage for this case.
    boomanaiden154 committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    d3d2716 View commit details
    Browse the repository at this point in the history
  2. updated StreamingTextDataset and StreamingFinetuningDataset with new …

    …streaming args, bumped streaming version
    snarayan21 committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    411d92d View commit details
    Browse the repository at this point in the history
  3. updated StreamingTextDataset and StreamingFinetuningDataset with new …

    …streaming args, bumped streaming version
    snarayan21 committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    65a936c View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2023

  1. Configuration menu
    Copy the full SHA
    1185fa7 View commit details
    Browse the repository at this point in the history