Update stability tests #1483
Update stability tests #1483
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## develop #1483 +/- ##
===========================================
- Coverage 80.85% 80.85% -0.01%
===========================================
Files 271 273 +2
Lines 30689 31405 +716
Branches 6197 6321 +124
===========================================
+ Hits 24815 25393 +578
- Misses 4489 4588 +99
- Partials 1385 1424 +39
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. |
| - python-version: "3.11" | ||
| tox-env-py: "311" | ||
| name: stability test (Python ${{ matrix.python-version }}, Extra ${{ matrix.extra }}) | ||
| runs-on: ubuntu-latest |
There was a problem hiding this comment.
can I ask you why testing on different os is dropped?
There was a problem hiding this comment.
we're using fuzzing tool atheris but they does not support windows.
There was a problem hiding this comment.
Is this okay to skip tests for windows?
There was a problem hiding this comment.
current fuzzing implementation is very primitive and works only with datumaro CLI. but I can say that this changes would cover small portion of stability tests that required to this product. it's better to work as well for the windows but it's not supported by a tool of fuzzing we're using.
Summary
Update weekly workflow to run fuzzing with different extra installation option instead of pytest-loop.
How to test
Checklist
License
Feel free to contact the maintainers if that's a concern.