The most confusing thing to me about AI and LLM progress in the past 4 years is that I can't clearly see how all novel patterns add up, or what was the right point.

I think adding harness + MCP + chain of thought + specialized data generation resulted in the world where we have now - the one where you don't have to type code manually, but sometimes do still have to think and sometimes don't.

But LLMs without all this tooling and calls under the hood are still kind of... LLMs. If there's a space to hallucinate - they will hallucinate.