-
-
Notifications
You must be signed in to change notification settings - Fork 169
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add scripts and tests to reproduce fuzzer errors in pytest #587
Add scripts and tests to reproduce fuzzer errors in pytest #587
Conversation
niccokunzmann
commented
Nov 21, 2023
- move fuzzing tests in to test folder
- create a script that runs the fuzzer and extracts the test case if the test fails
- move fuzzing tests in to test folder - create a script that runs the fuzzer and extracts the test case if the test fails
Pull Request Test Coverage Report for Build 6945563133
💛 - Coveralls |
My intention is to create small pull requests like this one: niccokunzmann#2 https://github.com/niccokunzmann/icalendar/actions/runs/6945596913/job/18895335145?pr=2 shows how the errors are reproduced. See also #578 |
Pull Request Test Coverage Report for Build 6945838229
💛 - Coveralls |
My idea is that I create the infrastructure to reproduce the tests easily. From there on, each time I get an email about a new error, I will create a PR with the error so it can be reproduced. |
@niccokunzmann This is very cool! I just want to make sure of a few things
|
Yes, I did that. This allowed me to extract the ICS file used.
That is minimal (a few milliseconds if I look at it). The corpus has a few files in it. Printing these does not make is slower. Running the fuzzer and preparing the fuzzing tests take most of the time. Thanks for your reply! |
LGTM! |