LLM running tools in a loop is the core idea of ReAct agents, and is indeed one of the most effective way to extract value from a generative AI. Ironically, it's not about generation at all, we use the models classification skills to pick tools and text processing skills to take the context into account.

I tend to find that using LLMs for interpretation and classification is often more useful for a given business task than wholesale generation.