[Django]-Celery / RabbitMQ / Django not running tasks

2👍

✅

user2097159 thanks for pointing me in the right direction, I was not aware I also must run a worker using supervisor. I thought it was either a worker or a beat, but now I understand that I must have a worker to handle the task and a beat to fire off the task periodically.

Below is the missing worker config for supervisor:

[program:nrv_celery_worker]
; Worker
command=/Users/tsantor/.virtualenvs/nrv_env/bin/celery worker -A app --loglevel=INFO

; Project dir
directory=/Users/tsantor/Projects/NRV/nrv

; Logs
stdout_logfile=/Users/tsantor/Projects/NRV/nrv/logs/celery_worker.log
redirect_stderr=true

autostart=true
autorestart=true
startsecs=10
user=tsantor
numprocs=1

; Need to wait for currently executing tasks to finish at shutdown.
; Increase this if you have very long running tasks.
stopwaitsecs = 600

; When resorting to send SIGKILL to the program to terminate it
; send SIGKILL to its whole process group instead,
; taking care of its children as well.
killasgroup=true

; if rabbitmq is supervised, set its priority higher
; so it starts first
priority=998

I then reset the RabbitMQ queue. Now that I have both the beat and worker programs managed via supervisor, all is working as intended. Hope this helps someone else out.

👤tsantor

[Django]-How to create a dependant drop down using autocomplete light

0👍

You need to a start both a worker process and a beat process. You can create separate processes as described in tsantor’s answer, or you can create a single process with both a worker and a beat. This can be more convenient during development (but is not recommended for production).

From “Starting the scheduler” in the Celery documentation:

You can also embed beat inside the worker by enabling the workers -B option, this is convenient if you’ll never run more than one worker node, but it’s not commonly used and for that reason isn’t recommended for production use:

$ celery -A proj worker -B

For expression in Supervisor config files see https://github.com/celery/celery/tree/master/extra/supervisord/ (linked from “Daemonization”)

👤lofidevops

Source:stackexchange.com