Remix.run Logo
▲ criemen 7 hours ago

I'm curious, why would this not turn into an unlimited electricity flatrate? In most parts of the world, consumer electricity is charged by kWh, not as flat payment.

As long as tokens are as energy intense to compute as they are right now, I don't see a flatrate being a viable model.

▲pixl97 7 hours ago | parent | next [-]

Power and memory are apt to become the biggest billing constraints.

▲verdverm 7 hours ago | parent | prev [-]

Something close to how we rent other cloud resources today makes sense. We don't worry about electricity costs, it's built into the hourly prices, use as much of the hardware as you can. Electricity rates vary over the course of the day as well.

People don't like complex pricing. This would be for businesses running larger workloads. For individuals, the unlimited plan seems the most probable to me. This stuff is going to get real cheap in the coming years.

The energy needed per token is in dropping rapidly, even though the energy per-GPU is going up. We are seeing something like 10x improvements per year.