[Answer]-Django Sort By Id Of ManyToMany table

I think Ordering many-to-many relations in Django models has th answer you need.

You basically have to manually specify the through table and guarantee the ordering in there.