Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Solve Kombu filesystem transport not thread safe #1593

Merged
merged 2 commits into from
Sep 7, 2022

Conversation

karajan1001
Copy link
Contributor

fix: #398
Currently only write lock used in msg/exchange file written. Cause
reading in other thread got some incomplete result.

  1. Add timeout for the lock acquire.
  2. Add Share locks when reading message from filesystem.
  3. Add a unit test for the lock and unlock
  4. Add a unit test to test the lock during message processing.

@auvipy auvipy added this to the 5.3 milestone Sep 6, 2022
fix: celery#398
Currently only write lock used in msg/exchange file written. Cause
reading in other thread got some incomplete result.

1. Add timeout for the lock acquire.
2. Add Share locks when reading message from filesystem.
3. Add a unit test for the `lock` and `unlock`
4. Add a unit test to test the lock during message processing.
t/unit/transport/test_filesystem.py Fixed Show resolved Hide resolved
@lgtm-com
Copy link

lgtm-com bot commented Sep 6, 2022

This pull request fixes 1 alert when merging 4b7e67d into ec533af - view on LGTM.com

fixed alerts:

  • 1 for Unused import

@lgtm-com
Copy link

lgtm-com bot commented Sep 7, 2022

This pull request fixes 1 alert when merging 8e66845 into ec533af - view on LGTM.com

fixed alerts:

  • 1 for Unused import

@auvipy auvipy merged commit 8699920 into celery:master Sep 7, 2022
@karajan1001 karajan1001 deleted the fix398 branch September 8, 2022 02:44
@karajan1001 karajan1001 restored the fix398 branch September 9, 2022 13:37
@karajan1001 karajan1001 deleted the fix398 branch September 9, 2022 13:37
@karajan1001 karajan1001 restored the fix398 branch September 9, 2022 13:37
karajan1001 added a commit to karajan1001/kombu that referenced this pull request Sep 9, 2022
auvipy pushed a commit that referenced this pull request Sep 9, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Kombu filesystem transport not thread safe
2 participants