But the understanding of the language library ecosystem, or even better, your codebase, could let it execute faster and with less context usage.

That's the bit I feel you can do with ragging - keep a large library of well described solutions and then find what you need from it at runtime.