Remix.run Logo
▲ khimaros 4 hours ago

that was always the promise wasn't it? linear increase in intelligence in exchange for exponential increase in compute?

▲minraws 4 hours ago | parent [-]

It's not really if you mean to point to the bitter lesson, it was models/intelligence scales better with general/simple methods with more compute better than it scales with any hand-crafted human program/method.

Ala intelligence is a function of compute, there was no guarantee that you need to 10x compute for 10% better performance or something like that.

If you ask the labs they will say the scaling is fairly linear or atleast sub-quadratic, they definitely won't say it's exponential.

No one was thinking we need to 10x compute from here again for another 10-20% increase in performance.

It's only been since Opus 4.6 that the compute growth vs improvements are starting to feel this way.

For instance GPT-3 vs GPT-4 was practically a 10-100x jump for a 10-100x increase in compute, we went from broken sentences to fully formed essays writing, speech and so on.

GPT-4 vs GPT-5 was just as massive we went from no agentic capabilities to fully agentic, 10-100x for a 10-100x increase in compute usage.

GPT-5 vs GPT-6 was atleast a 10x (upto 100x) increase in compute, but the difference is not that clear sure people say that one is significantly better than the other, but GPT-5.5 was good enough compared to where we are today.

Even on benchmarks compared to GPT-5.2 Codex we have almost 2x'ed the performance on say artificial analysis (53 vs 29). This is absurd. 10-100x increase in compute for 2-5x performance improvement is a massive gap.

[1]: https://bitterlesson.ai/ [2]: https://artificialanalysis.ai/?models=gpt-6-astra%2Cgpt-6-lu...