Remix.run Logo
▲ bob1029 an hour ago

Tokens per megawatt is about to go through the roof with things like disaggregated inference on the horizon.

This is going to quickly become similar to worrying about how many trainloads of coal it takes to run everyone's WiFi router.

▲speedping an hour ago | parent | next [-]

https://en.wikipedia.org/wiki/Jevons_paradox

It costs less -> we use much more -> total resource usage increases

▲stephbook an hour ago | parent | next [-]

Yep. People now use AI for what would have been a cached Google Search. Or AI for Photoshop.

▲bob1029 41 minutes ago | parent | prev [-]

Up to a point, yes. The paradox doesn't last forever.

▲ an hour ago | parent | prev [-]
[deleted]