Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch to rabbitmq based task queue #249

Merged
merged 12 commits into from
Aug 2, 2022
Merged

Switch to rabbitmq based task queue #249

merged 12 commits into from
Aug 2, 2022

Conversation

sunu
Copy link
Contributor

@sunu sunu commented Apr 4, 2022

Part of the work to fix alephdata/aleph#2127

Makes ingest-file use the RabbitMQ based workers.

@sunu sunu marked this pull request as ready for review May 2, 2022 07:40
@sunu sunu changed the title WIP: Switch to rabbitmq based task queue Switch to rabbitmq based task queue May 2, 2022
@sunu sunu merged commit 9155a08 into main Aug 2, 2022
catileptic pushed a commit that referenced this pull request Dec 7, 2023
* WIP: Switch to rabbitmq based task queue

* newer servicelayer

* Queue names are defined through servicelayer settings

* Push docker images for task-queue branch so that we can use it in Aleph

don't wanna wait till the ingest-file changes get merged to use them in
the related branch in the Aleph repo

* Update requirements to install optional dependencies of servicelayer

* update servicelayer

* upgrade servicelayer

* update servicelayer

* update servicelayer

* Upgrade servicelayer

* Use the latest servicelayer release
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Improve task queuing and processing
1 participant