the total cost spent on tokens may go up, but i just cant imagine per token costs going up

Depends on compute capacity. If we become supply constrained on tokens, then prices will necessarily go up.

	▲	anthonypasq 6 hours ago \| parent [-]
		no they dont because inference stacks are getting more efficient and models are getting more intelligent per parameter.