> I'm of the belief that LLMs are too verbose and energy intensive to go from language regurgitation machines to moving in the real world according to free form prompting.

This is not just possible, it is already happening. It just gets drowned in the media noise about chatbots. Look at some current research in this area (e.g. by Nvidia last year).