Celery queues and Redis queues

Question

I was looking at some tutorials for setting up Redis (message broker) + Celery for Django and I'm a little confused about how the queues work. The tutorial I followed was https://hackernoon.com/asynchronous-tasks-with-celery-redis-in-django-3e00d3735686

Does redis have an inbuilt queue as the message broker? Or is the queue a part of celery?
Which queue is the task pushed onto? The redis queue or the celery queue?

In this diagram it looks like redis and celery have their own queues

Stuart Buckingham · Accepted Answer · 2020-02-24 20:54:49Z

3

Celery does not have its own queue (at least not in that architecture). Redis will hold all the tasks in the queue, and then a celery worker node will consume the task from the Redis queue.

answered Feb 24, 2020 at 20:54

Stuart Buckingham

1,86419 silver badges28 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

CodeGator Over a year ago

The arch. from the tutorial or diagram?

Stuart Buckingham Over a year ago

Both. They both describe the same process. Celery is not supposed to be stateful, it just does something and then moves onto the next task.

Stuart Buckingham Over a year ago

Here's a minimum working example if it helps: github.com/stuart23/django-kubernetes-demo/tree/celery

Collectives™ on Stack Overflow

Celery queues and Redis queues

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related