-
Notifications
You must be signed in to change notification settings - Fork 76
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adding huggingface generators for clrs text #135
base: master
Are you sure you want to change the base?
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hello, thank you for your contribution! Apologies for the delay in reply.
In this iteration I added mostly general feedback about code structure and layout.
Co-authored-by: Olga Kozlova <grenlaykk@gmail.com>
… instead of exactly equal sampling. Added a use_hints field so data with and without hints can be identified per sample.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you for such a fast response!
I realized that I forgot to mention one significant point during the last iteration: we don't really need 2 separate generator functions, because they are almost identical, we can simply utilize different values for num_samples
argument (i.e. set it to None
or integer value).
Regarding the tests, I propose that I modify them myself and ask you to review them. Let me know what you think about it.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hi Sean!
Thank you for amazing work you've done! I left 2 small comments to address. Thanks!
Jfyi I will add the test file tomorrow in the morning and ask both of you for the final review. Thanks! |
"Pull request authors can’t approve their own pull request." |
Adding Huggingface Datasets
.from_generator
support to allow for CLRS-Text datasets to be easily converted to huggingface format.