Ah thats the rate limit we have in nginx. I suppose we should increase that.

Edit: I increased the rate limit so this problem wont happen anymore.