When latency is not on your side