[Answer]-Binding data to django model formsets

Try the queryset keyword argument:

answers_qs = my_question.answer_set
AnswerFormSet = modelformset_factory(Answer,
                                     formset=BaseAnswerFormSet,
                                     form=AnswerModelForm,
                                     queryset=answers_qs)