How would it be a money grab? If the new tokenizer requires more tokens to encode the same information, it costs them more money for inference. The point of charging per token is that the cost is proportional to the number of tokens. That's my understanding anyway

▲

abrookewood 6 days ago | parent | next [-]

Because everyone burns through their limits much faster, forcing them to upgrade to higher limits or new tiers.

▲

Jtarii 6 days ago | parent | next [-]

I think someone would much sooner switch to a competitor than up their tier.

	▲	dandaka 6 days ago \| parent [-]
		If model provider believes they have a better model, it can be a viable bet. But many (me included) started experimenting with other providers because of enshittification from Anthropic (price + uptime). Only to find, that Codex is not that worse in quality for a significantly more output per $.

▲

simianwords 6 days ago | parent | prev [-]

They could just increase the token cost no? There’s little need for cute conspiracies like these

	▲	sumeno 6 days ago \| parent \| next [-]
		They would have to tell people if they did that.
	▲	svnt 6 days ago \| parent \| prev [-]
		There are no conspiracies where a corporation has profit incentive. There is perhaps a question of planning and initial intentionality, but the metrics and motivation to continue are clear enough.

▲

msp26 6 days ago | parent | prev [-]

Not necessarily with speculative decoding. Whitespace would be trivial to predict and they would petty much keep using the same amount of compute as before.

I don't think that's their primary motive for doing this but it is a side effect.