1
Take a look at the has_delete_permission method in ModelAdmin. It sounds like all you would need to do is override that:
def has_delete_permission(self, request, obj = None):
if request.user == obj.user:
return True
return False
Source:stackexchange.com