Right? How do people not understand this? Have fun with your super-high latency when the DCs leave your city.

3eb7988a1663 4 hours ago | parent | next [-]

The signal speed in fiber is some 200k km/s. If you go 10 miles outside of a city, you are adding 0.1ms ping, and you will have dramatically fewer pitch forks.

The ping between New York and LA is ~70msec. Chatting with a LLM is not latency sensitive.

	▲	kube-system 2 hours ago \| parent \| next [-]
		But if it’s a colo it’s unlikely to have many LLMs running there. The big AI datacenters are mostly purpose built.
	▲	bryan_w 2 hours ago \| parent \| prev [-]
		Is this DC even for LLMs? I've not seen any sign of that. Considering that the initial build out was only 10MW, it seems unlikely that was the primary usecase.

▲

kube-system 5 hours ago | parent | prev | next [-]

It’s not necessarily “super high” latency to connect to data centers at a distance. Whether or not it matters depends on the application, and for most consumer applications it isn’t a huge issue. For AI data centers it doesn’t really matter.

▲

5 hours ago | parent | prev [-]

[deleted]