Remix.run Logo
▲ bigmadshoe 7 hours ago

From reading the blog post, it is essentially exactly the same as the car example. It delivers the same performance on tasks, but using 40% fewer tokens. This is the same as a car getting you to the same destination but wasting less energy on excess heat, wind resistance, or whatever else affects fuel economy (I am not an expert, obviously). I am paying for an LLM to complete tasks for me, not for the intermediate tokens.

▲verdverm 7 hours ago | parent [-]

I'm with you, I wrote prior comment under the assumption that they were priced differently (from GP claim as such), but they are priced the same (on Fireworks)

Will be taking Ember-1 for a spin on Monday and hopefully enjoy those better MPGs