[Solved]-Celery tasks not throwing exception in Django Tests

Under celery 4.0, I had to use CELERY_TASK_EAGER_PROPAGATES

@override_settings(task_always_eager=True, task_eager_propagates=True)
def test_my_task(self):
    pass

is what worked for me using Celery 5.

Documentation on config name changes: https://docs.celeryq.dev/en/stable/userguide/configuration.html