That's fair, and perhaps a different kind of multi-modal model will emerge that is better at learning and interacting with UIs..

Or maybe applications will develop new interfaces to meet LLMs in the middle, sort of how MCP servers are a very primitive version of that for APIs..

Future improvements don't just have to be a better version of exactly what it is today, it can certainly mean changing or combining approaches.

Leaving AI/LLM aside, 3D modeling and animation tech has drastically evolved over the years, removing the need for lots of manual and complicated work by automating or simplifying the workflow for achieving better results.