| ▲ | Der_Einzige a day ago | ||||||||||||||||
Wrong, custom "specs" i.e. schemas, are literally all we have for "real" guardrails with LLMs. https://developers.openai.com/api/docs/guides/structured-out... Nothing else operates on the logprobs level and literally bans continuations that fail your schema. | |||||||||||||||||
| ▲ | scwoodal a day ago | parent [-] | ||||||||||||||||
Enforcing structured outputs from LLMs is not the same thing as using linters, formatters, static analysis to control how an agent writes code. | |||||||||||||||||
| |||||||||||||||||