Remix.run Logo
sareiodata 3 hours ago

Smaller models really arent great at structured output. If this works it would be great for a local model that might not be as good but as long as it respects structured output will be vastly more useful.

yoeven 43 minutes ago | parent | next [-]

We have a full benchmark breakdown specifically on structured output that you can take a look at https://interfaze.ai/leaderboards/structured-output-benchmar...

OutOfHere 2 hours ago | parent | prev [-]

> Smaller models really arent great at structured output.

That is a straight-up lie. Consider gpt-5.4-nano which supports structured output just fine.

https://developers.openai.com/api/docs/models/gpt-5.4-nano

It seems like a concern that's orthogonal to the model size.

nosyke an hour ago | parent [-]

I genuinely doubt that they are just lying though lol