Skip to content

Commit

Permalink
chore: add more info on cloud loading
Browse files Browse the repository at this point in the history
  • Loading branch information
NanoCode012 committed Nov 16, 2023
1 parent 47dfde6 commit 3054512
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -398,7 +398,8 @@ See [examples](examples) for quick start. It is recommended to duplicate and mod
type: context_qa.load_v2
train_on_split: validation

# dataset with splits, but no train split
# loading from s3 or gcs
# s3 creds will be loaded from the system default and gcs only supports public access
dataset:
- path: s3://path_to_ds # Accepts folder with arrow/parquet or file path like above. Supports s3, gcs.
...
Expand Down

0 comments on commit 3054512

Please sign in to comment.