| ▲ | storystarling 3 hours ago | |
I tried this recently and found the token overhead makes it prohibitive for any non-trivial schema. Dumping the full introspection result into the context window gets expensive fast and seems to increase hallucination rates compared to just providing specific, narrow tool definitions. | ||
| ▲ | mmasu 3 hours ago | parent [-] | |
a friend (and colleague, disclaimer) pushed this recently to github. It passes data through a duck fb layer exactly to avoid context bloat: https://github.com/agoda-com/api-agent worth taking a look to see multiple approaches to the problem | ||