If inference wasn't profitable why are consumer GPUs that are only good for running open models so expensive? Why and how would these companies sell access to open models if it wasn't profitable? You can rent your own GPU and make money if your electricity is cheap enough.

>You can rent your own GPU and make money if your electricity is cheap enough.

I would be curious to know whether you'd make more profit from the same kWh of electricity mining bitcoin versus serving inference. I know they use different hardware, but since the "inference is profitable" discussion ignores the purchase price of the GPU, let's pretend you could have opted to buy an ASIC instead.