And for those on API billing? Opus is still quite pricy for what you're getting done with it.

airstrike a day ago | parent | next [-]

> And for those on API billing?

Opus-tier on open models and local hardware.

jrflo a day ago | parent | prev | next [-]

If you're on API billing then presumably you're a business, and $1,000 a month is still reasonable for that quality of work

szatkus a day ago | parent | next [-]

Those subscriptions won't be subsidized forever. At least not as much as they are today.

	▲	selectodude a day ago \| parent \| next [-]
		API token inference is subsidizing the rest of the business.
	▲	cortesoft a day ago \| parent \| prev \| next [-]
		People keep saying this, but inference itself is not what is being subsidized. The expense for electricity/hardware/datacenter operations/etc for an inference token is less than what they charge for it, so that cost doesn’t HAVE to go up to be profitable. The thing that is being subsidized is the TRAINING costs, and that is because they aren’t selling enough tokens yet to pay for the training costs. This is just like most other growth businesses, though, and if enough people use enough inference, it can be self sustaining.
	▲	scrollop a day ago \| parent \| prev [-]
		Price per token is dropping (though anthropic are doing dastardly things such as using new tokenizers that use 30% more tokens), efficiency will likely increase. If the subscriptions (of all of the big companies - unlikely?) give a poor amount of value in the future, will move to trusted/open router and use a harness that uses the latest cheap good models for most things, more expensive models as orchestrators. Already there are non-SOTA models that should be sufficient for most non-coding tasks, and soon for coding, also. The future is bright, in that respect, without subsidizing the ridiculous IPOs.