Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

🚀 Add MVTec LOCO dataset and sPRO metric #1967

Open
wants to merge 72 commits into
base: main
Choose a base branch
from
Open

🚀 Add MVTec LOCO dataset and sPRO metric #1967

wants to merge 72 commits into from

Commits on Feb 9, 2024

  1. add FROM_DIR option to val split mode to support a provided val dir… 

    …ectory

Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    c5c6bc7 View commit details
    Browse the repository at this point in the history

  2. add a conditional check for the FROM_DIR option of val split mode 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    4c76092 View commit details
    Browse the repository at this point in the history

  3. add the mvtec loco ad dataset classes 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    ecc7169 View commit details
    Browse the repository at this point in the history

  4. add the default config file for mvtec loco ad dataset 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    9d89a68 View commit details
    Browse the repository at this point in the history

  5. update initialization files to include MVTec LOCO dataset 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    a312be0 View commit details
    Browse the repository at this point in the history

  6. remove unnecessary Path conversion 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    37a6f6b View commit details
    Browse the repository at this point in the history

  7. add mvtec_loco.yaml to the readme documentation of configs 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    a733bf7 View commit details
    Browse the repository at this point in the history

  8. add dummy image generation for mvtec loco dataset 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    38ad1f4 View commit details
    Browse the repository at this point in the history

  9. add unit test for mvtec loco dataset 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    05e3558 View commit details
    Browse the repository at this point in the history

  10. update changelog to include the addition of mvtec loco dataset 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    519780a View commit details
    Browse the repository at this point in the history

  11. add mvtec loco dataset to the sphinx-based docs 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    c3c6a39 View commit details
    Browse the repository at this point in the history

  12. fix the malformed table 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    ca91b8e View commit details
    Browse the repository at this point in the history

  13. binarize the masks and avoid the possibility of the merge_mask is None 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    37f4dbc View commit details
    Browse the repository at this point in the history

  14. Merge the masks using sum operation without binarization 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    3559a7c View commit details
    Browse the repository at this point in the history

  15. override getitem method to handle binarization and to add additional … 

    …'masks' item

Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    83539b4 View commit details
    Browse the repository at this point in the history

  16. Add saturation config to the datamodule 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    ddd33c5 View commit details
    Browse the repository at this point in the history

  17. Update the saturation config on the metrics based on the loaded confi… 

    …g from the dataset

Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    3af6eeb View commit details
    Browse the repository at this point in the history

  18. add masks as a keyword args to the update method of the AnomalibMetri… 

    …cCollection

Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    53f2297 View commit details
    Browse the repository at this point in the history

  19. Shorten the comments to solve ruff issues 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    3d00d69 View commit details
    Browse the repository at this point in the history

  20. Add sPro metric implementation 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    f024e91 View commit details
    Browse the repository at this point in the history

  21. Change the saturation threshold to tensor 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    9b8ca3b View commit details
    Browse the repository at this point in the history

  22. Handle case with only background/normal images in scoring 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    29aaf46 View commit details
    Browse the repository at this point in the history

  23. rename spro metric and change the default value of saturation_config … 

    …to None

Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    f432753 View commit details
    Browse the repository at this point in the history

  24. add unit test for spro metric 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    7d348d8 View commit details
    Browse the repository at this point in the history

  25. fix pre-commit issues 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    5597bfc View commit details
    Browse the repository at this point in the history

  26. handle file not found error when loading saturation config 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    7b02863 View commit details
    Browse the repository at this point in the history

  27. validate path before processing 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    6048a08 View commit details
    Browse the repository at this point in the history

  28. update changelog with new PR 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    e237347 View commit details
    Browse the repository at this point in the history

  29. Update src/anomalib/data/image/mvtec_loco.py 

    Co-authored-by: Samet Akcay <samet.akcay@intel.com>
Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh @samet-akcay
    willyfh and samet-akcay committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    f9b67b8 View commit details
    Browse the repository at this point in the history

  30. Update src/anomalib/data/image/mvtec_loco.py 

    Co-authored-by: Samet Akcay <samet.akcay@intel.com>
Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh @samet-akcay
    willyfh and samet-akcay committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    63bf8de View commit details
    Browse the repository at this point in the history

  31. Update tests/helpers/data.py 

    Co-authored-by: Samet Akcay <samet.akcay@intel.com>
Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh @samet-akcay
    willyfh and samet-akcay committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    0310e1b View commit details
    Browse the repository at this point in the history

Commits on Feb 10, 2024

  1. change assert to raise error 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 10, 2024
    Configuration menu
    Copy the full SHA
    4eb2ec3 View commit details
    Browse the repository at this point in the history

  2. return list of masks instead of merging the multiple masks from the d… 

    …ataset

Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 10, 2024
    Configuration menu
    Copy the full SHA
    f3bccb8 View commit details
    Browse the repository at this point in the history

  3. collate masks as a list of tensor to avoid stack error due to unequal… 

    … number of masks

Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 10, 2024
    Configuration menu
    Copy the full SHA
    ac1ecb1 View commit details
    Browse the repository at this point in the history

  4. update spro to handle list of masks and remove the _ args 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 10, 2024
    Configuration menu
    Copy the full SHA
    3bbc750 View commit details
    Browse the repository at this point in the history

  5. update unit test to use list of masks as the target 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 10, 2024
    Configuration menu
    Copy the full SHA
    e8e7360 View commit details
    Browse the repository at this point in the history

  6. update type and docstring of spro_score function 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 10, 2024
    Configuration menu
    Copy the full SHA
    ccef95c View commit details
    Browse the repository at this point in the history

  7. remove _saturation_config attribute from metric collection module 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 10, 2024
    Configuration menu
    Copy the full SHA
    2cdeb82 View commit details
    Browse the repository at this point in the history

Commits on Feb 11, 2024

  1. remove unnecessary lines 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 11, 2024
    Configuration menu
    Copy the full SHA
    d2cbcf3 View commit details
    Browse the repository at this point in the history

  2. add unit test to make sure the mask is binary 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 11, 2024
    Configuration menu
    Copy the full SHA
    829289b View commit details
    Browse the repository at this point in the history

  3. add warning when the saturation threshold is larger than the defect area 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 11, 2024
    Configuration menu
    Copy the full SHA
    53aa07f View commit details
    Browse the repository at this point in the history

  4. Move the loading process of saturation config from dataset to metric 

    Signed-off-by: Willy Fitra Hendria <willyfitrahendria@gmail.com>
    @willyfh
    willyfh committed Feb 11, 2024
    Configuration menu
    Copy the full SHA
    d9a2333 View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. merge main

    @djdameln
    djdameln committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    c1b7a28 View commit details
    Browse the repository at this point in the history

  2. merge main

    @djdameln
    djdameln committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    8785aa2 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'mvtec_loco' into feature/mvtec-loco

    @djdameln
    djdameln committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    a767052 View commit details
    Browse the repository at this point in the history

  4. Update src/anomalib/metrics/spro.py

    @samet-akcay
    samet-akcay authored Apr 9, 2024
    Configuration menu
    Copy the full SHA
    930cfe2 View commit details
    Browse the repository at this point in the history

  5. update hashsum

    @djdameln
    djdameln committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    a2c529c View commit details
    Browse the repository at this point in the history

  6. update example

    @djdameln
    djdameln committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    0c68c90 View commit details
    Browse the repository at this point in the history

  7. remove duplicate parameter

    @djdameln
    djdameln committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    d6bd7fb View commit details
    Browse the repository at this point in the history

  8. Merge branch 'feature/mvtec-loco' of github.com:openvinotoolkit/anoma… 

    …lib into feature/mvtec-loco
    @djdameln
    djdameln committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    4a8e487 View commit details
    Browse the repository at this point in the history

  9. Update src/anomalib/data/base/datamodule.py 

    Co-authored-by: Samet Akcay <samet.akcay@intel.com>
    @djdameln @samet-akcay
    djdameln and samet-akcay authored Apr 9, 2024
    Configuration menu
    Copy the full SHA
    934f753 View commit details
    Browse the repository at this point in the history

  10. move and update loco config

    @djdameln
    djdameln committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    63f210e View commit details
    Browse the repository at this point in the history

  11. Merge branch 'feature/mvtec-loco' of github.com:openvinotoolkit/anoma… 

    …lib into feature/mvtec-loco
    @djdameln
    djdameln committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    98cd7f6 View commit details
    Browse the repository at this point in the history

  12. Update tests/unit/data/image/test_mvtec_loco.py 

    Co-authored-by: Samet Akcay <samet.akcay@intel.com>
    @djdameln @samet-akcay
    djdameln and samet-akcay authored Apr 9, 2024
    Configuration menu
    Copy the full SHA
    ba371c4 View commit details
    Browse the repository at this point in the history

  13. Update tests/unit/metrics/test_spro.py 

    Co-authored-by: Samet Akcay <samet.akcay@intel.com>
    @djdameln @samet-akcay
    djdameln and samet-akcay authored Apr 9, 2024
    Configuration menu
    Copy the full SHA
    114f8e6 View commit details
    Browse the repository at this point in the history

  14. Update src/anomalib/data/image/mvtec_loco.py 

    Co-authored-by: Samet Akcay <samet.akcay@intel.com>
    @djdameln @samet-akcay
    djdameln and samet-akcay authored Apr 9, 2024
    Configuration menu
    Copy the full SHA
    7dbb983 View commit details
    Browse the repository at this point in the history

  15. Update src/anomalib/cli/cli.py 

    Co-authored-by: Ashwin Vaidya <ashwin.vaidya@intel.com>
    @djdameln @ashwinvaidya17
    djdameln and ashwinvaidya17 authored Apr 9, 2024
    Configuration menu
    Copy the full SHA
    6587cac View commit details
    Browse the repository at this point in the history

  16. Update src/anomalib/metrics/spro.py 

    Co-authored-by: Samet Akcay <samet.akcay@intel.com>
    @djdameln @samet-akcay
    djdameln and samet-akcay authored Apr 9, 2024
    Configuration menu
    Copy the full SHA
    36ebf1c View commit details
    Browse the repository at this point in the history

  17. Update src/anomalib/metrics/spro.py 

    Co-authored-by: Samet Akcay <samet.akcay@intel.com>
    @djdameln @samet-akcay
    djdameln and samet-akcay authored Apr 9, 2024
    Configuration menu
    Copy the full SHA
    b998823 View commit details
    Browse the repository at this point in the history

  18. fix mask loading

    @djdameln
    djdameln committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    c844c1d View commit details
    Browse the repository at this point in the history

  19. Merge branch 'feature/mvtec-loco' of github.com:openvinotoolkit/anoma… 

    …lib into feature/mvtec-loco
    @djdameln
    djdameln committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    501c116 View commit details
    Browse the repository at this point in the history

  20. ruff

    @djdameln
    djdameln committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    58c3b3f View commit details
    Browse the repository at this point in the history

  21. fix multiple mask loading

    @djdameln
    djdameln committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    4028b9a View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2024

  1. masks -> semantic_mask

    @djdameln
    djdameln committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    c87f742 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into feature/mvtec-loco

    @djdameln
    djdameln committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    eabb755 View commit details
    Browse the repository at this point in the history

Commits on May 1, 2024

  1. add metric collection for semantic pixel metrics

    @djdameln
    djdameln committed May 1, 2024
    Configuration menu
    Copy the full SHA
    15e1e74 View commit details
    Browse the repository at this point in the history

Commits on May 3, 2024

  1. add comment

    @djdameln
    djdameln committed May 3, 2024
    Configuration menu
    Copy the full SHA
    69953ed View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. merge main

    @djdameln
    djdameln committed May 16, 2024
    Configuration menu
    Copy the full SHA
    38d98c2 View commit details
    Browse the repository at this point in the history

  2. check if val_data is assigned for val_split_mode from_dir

    @djdameln
    djdameln committed May 16, 2024
    Configuration menu
    Copy the full SHA
    3ffee16 View commit details
    Browse the repository at this point in the history

  3. initialize semantic pixel metric names as list

    @djdameln
    djdameln committed May 16, 2024
    Configuration menu
    Copy the full SHA
    b7c0d94 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2024

  1. Merge branch 'main' of github.com:openvinotoolkit/anomalib into featu… 

    …re/mvtec-loco
    @samet-akcay
    samet-akcay committed May 17, 2024
    Configuration menu
    Copy the full SHA
    9da8a68 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. Merge branch 'main' into feature/mvtec-loco

    @ashwinvaidya17
    ashwinvaidya17 authored May 23, 2024
    Configuration menu
    Copy the full SHA
    1cc19d7 View commit details
    Browse the repository at this point in the history