[Answered ]-Slow uploads Nginx and Gluster

So, we solved the problem. It had nothing to do with any of our code, server setup, or amazon. We narrowed it down to only linux machines uploading in our network. there was a bug with ‘tcp window scaling’ in the firewall that was resetting the upload after it reaches a limit.

Thanks for anyone that attempted.