Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add LossDynamicsAnalyzer for noisy label detection #928

Merged

Conversation

vinnamkim
Copy link
Contributor

@vinnamkim vinnamkim commented Apr 11, 2023

Summary

  • Ticket no. 103075
  • Added LossDynamicsAnalyzer for noisy label detection.
  • Added Jupyter notebook example for this feature.
  • Added ImagenetWithSubsetDirsExporter to support this feature.

How to test

I added some tests for this change.

Checklist

  • I have added unit tests to cover my changes.​
  • I have added integration tests to cover my changes.​
  • I have added the description of my changes into CHANGELOG.​
  • I have updated the documentation accordingly

License

  • I submit my code changes under the same MIT License that covers the project.
    Feel free to contact the maintainers if that's a concern.
  • I have updated the license header for each file (see an example below).
# Copyright (C) 2023 Intel Corporation
#
# SPDX-License-Identifier: MIT

Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

…amics-analyzer

Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
@vinnamkim vinnamkim marked this pull request as ready for review April 11, 2023 04:46
@vinnamkim vinnamkim requested review from a team as code owners April 11, 2023 04:46
@vinnamkim vinnamkim added this to the 1.2.0 milestone Apr 11, 2023
@vinnamkim vinnamkim added the FEATURE New feature & functionality label Apr 11, 2023
@codecov-commenter
Copy link

codecov-commenter commented Apr 11, 2023

Codecov Report

Patch coverage: 90.35% and project coverage change: +0.04 🎉

Comparison is base (bddf3cb) 78.73% compared to head (8f5b996) 78.78%.

Additional details and impacted files
@@             Coverage Diff             @@
##           develop     #928      +/-   ##
===========================================
+ Coverage    78.73%   78.78%   +0.04%     
===========================================
  Files          215      218       +3     
  Lines        25478    25575      +97     
  Branches      5085     5100      +15     
===========================================
+ Hits         20061    20148      +87     
- Misses        4255     4262       +7     
- Partials      1162     1165       +3     
Flag Coverage Δ
macos-11_Python-3.8 77.78% <90.35%> (+0.04%) ⬆️
ubuntu-20.04_Python-3.8 78.76% <90.35%> (+0.04%) ⬆️
windows-2019_Python-3.8 78.71% <90.26%> (+0.04%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
...ms/noisy_label_detection/loss_dynamics_analyzer.py 88.50% <88.50%> (ø)
datumaro/plugins/data_formats/imagenet.py 91.76% <92.30%> (+0.51%) ⬆️
datumaro/__init__.py 100.00% <100.00%> (ø)
datumaro/components/algorithms/__init__.py 100.00% <100.00%> (ø)
...nents/algorithms/noisy_label_detection/__init__.py 100.00% <100.00%> (ø)
datumaro/components/algorithms/rise.py 88.73% <100.00%> (+0.07%) ⬆️
datumaro/components/format_detection.py 93.58% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@vinnamkim vinnamkim merged commit 37b62bb into openvinotoolkit:develop Apr 12, 2023
@vinnamkim vinnamkim deleted the feature/loss-dynamics-analyzer branch April 12, 2023 01:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
FEATURE New feature & functionality
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants