3👍
You can select a queue -Q option for each worker to work on with --concurrency=1
celery -A proj worker --concurrency=1 -n user1@%h -Q User1_queue
@JamesFoley Although following could be implemented on celery side, for now it is not ( https://github.com/celery/celery/issues/1599 )
Some of ideas:
- dynamically spawn/control celery workers
- singular beat task to decide which tasks can be spawned to run ( lock/mutex or DB table monitoring tasks)
Source:stackexchange.com