Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] The NVTabular dataloader + sample weights #667

Closed
ethem-kinginthenorth opened this issue Mar 16, 2021 · 2 comments
Closed

[FEA] The NVTabular dataloader + sample weights #667

ethem-kinginthenorth opened this issue Mar 16, 2021 · 2 comments
Assignees

Comments

@ethem-kinginthenorth
Copy link

Is your feature request related to a problem? Please describe.
I wish I could use the NVTabular dataloader to do what TF does with sample weights. Here is the link: https://www.tensorflow.org/guide/keras/train_and_evaluate#sample_weights

Describe the solution you'd like
from TF: 'A "sample weights" array is an array of numbers that specify how much weight each sample in a batch should have in computing the total loss. It is commonly used in imbalanced classification problems (the idea being to give more weight to rarely-seen classes).'

If this feature is already implemented in, I would appreciate a simple example.

Thanks

@benfred
Copy link
Member

benfred commented Jun 14, 2021

This should be implemented with #850. @marcromeyn can you work with @bschifferer on an example?

@marcromeyn
Copy link
Contributor

We added a map function to the KerasSequenceLoader. This can be used to pass the sample-weight to the model, an example of this can be found in this test. Let us know if you run into any issues!

@benfred benfred closed this as completed Jun 28, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants