| ▲ | verdverm 7 hours ago | |||||||
it's not exactly the same, the model stills "weighs" the same here, it does less work, it's more like driving half as far but still paying the same total cost this being said, K3 and E1 models are priced the same at $3.00 / $0.30 / $15.00 | ||||||||
| ▲ | bigmadshoe 7 hours ago | parent [-] | |||||||
From reading the blog post, it is essentially exactly the same as the car example. It delivers the same performance on tasks, but using 40% fewer tokens. This is the same as a car getting you to the same destination but wasting less energy on excess heat, wind resistance, or whatever else affects fuel economy (I am not an expert, obviously). I am paying for an LLM to complete tasks for me, not for the intermediate tokens. | ||||||||
| ||||||||