| ▲ | lxxpxlxxxx 5 hours ago | |
My experience with these new releases is that the gains in performance are negated by the price increases and it seems like: Performance gains: 1.2x Price increases: 1.8x | ||
| ▲ | ddosmax556 5 hours ago | parent | next [-] | |
They're not negated, smarter is smarter, but you have to reach deeper in your pocket. I think this will happen more and more - the smartest models get more expensive. But it won't matter - the current models we have today will get cheaper and can still be used for what they're used today. | ||
| ▲ | energy123 4 hours ago | parent | prev [-] | |
Yet people don't use old models through the API much, because changes in benchmark space dont map linearly to changes in utility space. An improvement from 98% to 99%, which is 1pp, might be 2x as valuable for some application. Also benchmarks will asymptote no matter what, that's baked in. | ||