1ms latency is more than fast enough, you probably have bigger latency than that between the cpu and the gpu.

We've got 10ms of latency between our brains and our hands along our nerve fibers and we function all right.