until it doesn't.

scaling laws are a power law, you can only stay ahead for so long when each minor improvement gets exponentially more expensive