This behavior is part of the problem that got us here, using LLMs for everything.