Remix.run Logo
Kuinox 2 days ago

It would mean that inference is not profitable. Calculating inference costs show it's profitable, or close to.

renegade-otter a day ago | parent [-]

Inference costs have in fact been crashing, going from astronomical to... lower.

That said, I am not sure that this indicator alone tells the whole story, if not hides it - sort of like EBITDA.

Kuinox a day ago | parent [-]

I think there will still be cheap inference, what will rise in costs will be frontier model subscriptions. This is the thing that is not profitable.