fix: Huggingface Trust Remote Repo #9535
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Ticket
Description
Huggingface made a breaking change to their
datasets
repo. Running code locally now requirestrust_remote_code=True
in any API call that does aload
operation. See https://github.com/huggingface/datasets/releases/tag/2.20.0This PR adds this flag and sets it to true in our TrainerAPI examples.
Test Plan
CI passes, specifically:
test-e2e-gpu-distributed
andtest-e2e-gpu-nightly
Checklist
docs/release-notes/
See Release Note for details.