I have acid reflux every time I see the term "step change" used to talk about a model change. There hasn't been any model that has been a "step change" over its predecessor.

It's much more like each new model climbs another step of the ladder that goes up the step, and so far we can't even see the top of the ladder.

My suspicion is also that the ladder actually ends way before it reaches the next step, and LLMs are a dead end. Everything indicates it so far.

Let's not even talk about "reasoning models", aka spend twice the tokens and twice the time on the same answer.