> The LLM architectures we have now have reached their full potential already.

How do we know that?

what we can say right now is that we've hit the point of diminishing returns and the only way we're going to get signicantly more capable models is through a technological advance that we cannot forsee (and that may not come for decades if it ever comes)

Exactly. You're absolutely right to focus on that.