Remix.run Logo
▲ otterley 6 hours ago

Given that the number one cost of inference is memory and compute, and the incremental cost of each is energy, cost per inference is roughly proportional to energy consumption.