| ▲ | osti 5 days ago | |
This kinda tracks with the latest estimate of power usage of llm inference published by google https://news.ycombinator.com/item?id=44972808. If inference isnt that power hungry like people thought, they must be able to make good money from those subscriptions. | ||
| ▲ | jeffbee 5 days ago | parent [-] | |
> power hungry like people thought The only people who thought this were non-practitioners. | ||