You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A user should be able to execute a successful shuffle a second time after it has been forgotten. This is particularly important for interactive workloads. A possible solution may be to signed attempts for tasks (#7272) to differentiate between different attempts of a shuffle and limit tombstones to a specific attempt.
The text was updated successfully, but these errors were encountered:
The tombstones prohibit us from executing a shuffle twice even if it succeeded the first time and has since been forgotten. See
distributed/distributed/shuffle/tests/test_shuffle.py
Lines 892 to 918 in 401b51d
A user should be able to execute a successful shuffle a second time after it has been forgotten. This is particularly important for interactive workloads. A possible solution may be to signed attempts for tasks (#7272) to differentiate between different attempts of a shuffle and limit tombstones to a specific attempt.
The text was updated successfully, but these errors were encountered: