Add TabularValidator

[sooahleex]

Summary

• Add TabularValidator
• Validate annotations based on dataset after AstypeAnnotations
• Validation result consists of
  • defined_labels
  • empty_labels : which label is not set for item(= nan label)
  • defined_captions
  • empty_captions : which caption is not set for item (= nan caption)
  • redundancies
  • total_ann_count
  • items_missing_annotations : if item does not any annotations
  • items_broken_annotations
• Anomaly type consists of
  • MissingAnnotation : if item did not have any caption or label
  • BrokenAnnotations
  • FewSamplesInLabel
  • ImbalancedLabels
  • EmptyLabel : If value is Nan for a label
  • FewSamplesInCaption
  • RedundanciesInCaption
  • EmptyCaption : If value is Nan for a caption
  • ImbalancedCaptions : There is an imbalance in the caption distribution
  • ImbalancedDistInCaptions : Values are not evenly distributed for a caption only if caption is number
  • FarFromCaptionMean : An annotation has ann too small or large value than average for a caption only if caption is number
• Updating ConfigurableValidator will be covered following PR

How to test

• Add unit test for TabularValidator

Checklist

• I have added unit tests to cover my changes.​
• I have added integration tests to cover my changes.​
• I have added the description of my changes into CHANGELOG.​
• I have updated the documentation accordingly

License

• I submit my code changes under the same MIT License that covers the project.
  Feel free to contact the maintainers if that's a concern.
• I have updated the license header for each file (see an example below).

# Copyright (C) 2024 Intel Corporation
#
# SPDX-License-Identifier: MIT

[codecov]

Codecov Report

Attention: Patch coverage is 95.17685% with 15 lines in your changes are missing coverage. Please review.

Project coverage is 80.79%. Comparing base (44cc56a) to head (23ebb8b).
Report is 59 commits behind head on develop.

Files	Patch %	Lines
src/datumaro/plugins/validators.py	95.81%	3 Missing and 8 partials ⚠️
src/datumaro/components/errors.py	91.30%	4 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #1498      +/-   ##
===========================================
- Coverage    80.85%   80.79%   -0.07%     
===========================================
  Files          271      276       +5     
  Lines        30689    31680     +991     
  Branches      6197     6391     +194     
===========================================
+ Hits         24815    25597     +782     
- Misses        4489     4664     +175     
- Partials      1385     1419      +34     

Flag	Coverage Δ
ubuntu-20.04_Python-3.10	80.78% <95.17%> (-0.06%)	⬇️
windows-2022_Python-3.10	80.77% <95.17%> (-0.06%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.