Transformer-style attention archectiture and language models won’t bring about AGI, I agree - but you’d be foolish to think there aren’t OAI/Anthropic researchers working to invent the thing that will.

If anything, the transformer style attention architecture and language models have pushed AGI further into the future because the vast majority of finding for AGI research is going into the dead end of transformer style architecture and language models, pulling it away from methods that actually could achieve AGI.

major breakthroughs happen once a decade. its gonna take a long freaking time for anyone to get there because they ll need to invent a new architecture for this. one that does not hallucinate