Scaling "still works" for increasingly smaller improvements for increasing higher infrastructure costs.

As it was obvious from the start, transformers are not the path to AGI, if there's one.