-
Notifications
You must be signed in to change notification settings - Fork 11
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Unit Tests are Stochastic #459
Comments
From talking with @evrose54, it seems that most of the stochastic tests are gone. The only ones remaining is for testing To test coverage and print the lines that are not covered, use |
Search for |
|
Unit tests introduced in #444 are stochastic:
this increases run time performance. Which is very clever!
However, it is best practice that unit tests are repeatable, which this practice undermines.
I suggest using pytest marks instead to allow testers to choose to run the fast but random test suites or the slow but comprehensive tests. With marks, users could run
pytest -m slow
which would run all tests which are decorated with the @pytest.mark.slow decorator.If this is agreed upon as a good idea, I can write out a plan for development.
The text was updated successfully, but these errors were encountered: