Latency isn't really the issue here (lots of inference serving happening across oceans, which is probably 100-150ms RT), but bandwidth ends up becoming an issue for large scale transfers (mostly model weights, not the actual inference tokens/queries).

With laser terminals you’ll get a few gigabits per second. That’s possible both between sats and to the ground station. Probably not cheap though.