Remix.run Logo
3eb7988a1663 4 hours ago

The signal speed in fiber is some 200k km/s. If you go 10 miles outside of a city, you are adding 0.1ms ping, and you will have dramatically fewer pitch forks.

The ping between New York and LA is ~70msec. Chatting with a LLM is not latency sensitive.

kube-system 2 hours ago | parent | next [-]

But if it’s a colo it’s unlikely to have many LLMs running there. The big AI datacenters are mostly purpose built.

bryan_w 2 hours ago | parent | prev [-]

Is this DC even for LLMs? I've not seen any sign of that.

Considering that the initial build out was only 10MW, it seems unlikely that was the primary usecase.