Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Skip flaky test_autocast_cpu test #8580

Merged
merged 4 commits into from
Aug 10, 2024

Conversation

NicolasHug
Copy link
Member

These tests have been flaky for a while and are failing on 1/5000 expected values. It's not easy to specify the atol/rtol here, so I'm just skipping.

2024-08-10T15:17:12.2632960Z FAILED test/test_ops.py::TestRoIAlign::test_autocast_cpu[rois_dtype0-x_dtype1-True-True] - AssertionError: Tensor-likes are not close!
2024-08-10T15:17:12.2633430Z 
2024-08-10T15:17:12.2633500Z Mismatched elements: 1 / 5000 (0.0%)
2024-08-10T15:17:12.2633880Z Greatest absolute difference: 0.0078125 at index (0, 21, 4, 4) (up to 0.005 allowed)
2024-08-10T15:17:12.2634400Z Greatest relative difference: 0.015380859375 at index (0, 21, 4, 4) (up to 0.005 allowed)
2024-08-10T15:17:12.2635150Z FAILED test/test_ops.py::TestRoIAlign::test_autocast_cpu[rois_dtype0-x_dtype1-False-True] - AssertionError: Tensor-likes are not close!
2024-08-10T15:17:12.2635620Z 
2024-08-10T15:17:12.2635690Z Mismatched elements: 1 / 5000 (0.0%)
2024-08-10T15:17:12.2636060Z Greatest absolute difference: 0.0078125 at index (0, 21, 4, 4) (up to 0.005 allowed)
2024-08-10T15:17:12.2636570Z Greatest relative difference: 0.015380859375 at index (0, 21, 4, 4) (up to 0.005 allowed)
2024-08-10T15:17:12.2637360Z FAILED test/test_ops.py::TestRoIAlign::test_autocast_cpu[rois_dtype1-x_dtype1-True-True] - AssertionError: Tensor-likes are not close!
2024-08-10T15:17:12.2637830Z 
2024-08-10T15:17:12.2637900Z Mismatched elements: 1 / 5000 (0.0%)
2024-08-10T15:17:12.2638270Z Greatest absolute difference: 0.0078125 at index (0, 21, 4, 4) (up to 0.005 allowed)
2024-08-10T15:17:12.2638780Z Greatest relative difference: 0.015380859375 at index (0, 21, 4, 4) (up to 0.005 allowed)
2024-08-10T15:17:12.2639520Z FAILED test/test_ops.py::TestRoIAlign::test_autocast_cpu[rois_dtype1-x_dtype1-False-True] - AssertionError: Tensor-likes are not close!
2024-08-10T15:17:12.2640020Z 
2024-08-10T15:17:12.2640100Z Mismatched elements: 1 / 5000 (0.0%)
2024-08-10T15:17:12.2640460Z Greatest absolute difference: 0.0078125 at index (0, 21, 4, 4) (up to 0.005 allowed)
2024-08-10T15:17:12.2641060Z Greatest relative difference: 0.015380859375 at index (0, 21, 4, 4) (up to 0.005 allowed)

Copy link

pytorch-bot bot commented Aug 10, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/vision/8580

Note: Links to docs will display an error until the docs builds have been completed.

❌ 14 New Failures, 4 Unrelated Failures

As of commit 4fc4ce3 with merge base c449221 (image):

NEW FAILURES - The following jobs have failed:

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@NicolasHug NicolasHug merged commit c9936da into pytorch:main Aug 10, 2024
24 of 42 checks passed
@NicolasHug NicolasHug deleted the test_autocast_cpu branch August 10, 2024 16:07
facebook-github-bot pushed a commit that referenced this pull request Aug 15, 2024
Reviewed By: ahmadsharif1

Differential Revision: D61331607

fbshipit-source-id: cb66215023ea77336b9d16180c362cba3dde6201
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants