| ▲ | bigmadshoe 7 hours ago | |
From reading the blog post, it is essentially exactly the same as the car example. It delivers the same performance on tasks, but using 40% fewer tokens. This is the same as a car getting you to the same destination but wasting less energy on excess heat, wind resistance, or whatever else affects fuel economy (I am not an expert, obviously). I am paying for an LLM to complete tasks for me, not for the intermediate tokens. | ||
| ▲ | verdverm 7 hours ago | parent [-] | |
I'm with you, I wrote prior comment under the assumption that they were priced differently (from GP claim as such), but they are priced the same (on Fireworks) Will be taking Ember-1 for a spin on Monday and hopefully enjoy those better MPGs | ||