Remix.run Logo
toddmorey 5 hours ago

I mean, it's a structured output model that (apparently) can't hallucinate. I don't mind the name.

flyinglizard 4 hours ago | parent [-]

It can't hallucinate, but it doesn't mean it can't make wrong decisions. Just because it adheres to a specific output format at all time, while LLMs have the output format at their mercy, then the claim of not hallucinating is made technically true.

I think that this specific part is not super interesting if your harness just recovers from invalid LLM outputs.

The latency and cost - yes, those are super interesting.