AI companies have a financial incentive to burn more tokens than the task actually needs

Rudybega 4 hours ago | parent | next [-]

This is only true if they can't saturate token production with a model that does less superfluous things. Given that they can (they're hilariously compute strained), having a model that solves tasks more quickly adds way more perceived value to users.

	▲	ohyes 3 hours ago \| parent [-]
		Well they decide what a token is. So they can do less superfluous things and backfill with a weaker model.

▲

DonsDiscountGas 4 hours ago | parent | prev | next [-]

Only if the customer is paying per token. If it's by subscription they're burning their own money

	▲	blehn 5 minutes ago \| parent \| next [-]
		the subscriptions all have limits. when you hit the limit you again start paying per token.
	▲	3 hours ago \| parent \| prev [-]
		[deleted]

▲

pizzafeelsright 4 hours ago | parent | prev | next [-]

Agreed although the differences between the effort and reasoning is massive. I generally ship 40 hours in three with AI. I could not figure out why my delivery was behind until I started going through the logs. The thinking was extensive, the effort was beyond the original request by a magnitude of 50x

	▲	discreteevent 3 hours ago \| parent \| next [-]
		How do you even know that it's consistently 40 hours in 3? What kind of developer ever had that kind of estimation accuracy (unless it's really repetitive) or even focuses on productivity rather than the problem like that? This sounds more like factory work than design or development. I really don't get it.
	▲	owebmaster an hour ago \| parent \| prev [-]
		> I generally ship 40 hours in three with AI. You ship 3 hours in three with AI. The old number is meaningless now.

▲

eli_gottlieb 3 hours ago | parent | prev | next [-]

Just like me fr fr

▲

chrisjj 4 hours ago | parent | prev | next [-]

A.k.a. theft.

▲

simianwords 2 hours ago | parent | prev [-]

nice conspiracy theory, but it doesn't hold. these companies won't last long if people don't get actual work done.

	▲	owebmaster an hour ago \| parent [-]
		There's a big chance these companies won't last long