1👍
✅
Have you identified whether your slow scripts belong to CPU-bound tasks or I/O bound tasks?
if they’re I/O bound, you can use eventlet and gevent based on Strategy 1 in the blog from distributedpython.com
but if they’re CPU bound, you may have to think of using the ways like a dedicated Celery windows box (or windows Docker container) to workaround Celery billiard issue on Windows by setting the environment variable (FORKED_BY_MULTIPROCESSING=1
) based on Strategy 2 in the blog from distributedpython.com
Source:stackexchange.com