Remix.run Logo
Me1000 7 hours ago

Wouldn’t it be better to use a grammar in the token sampler? Tuning is fine, but doesn’t guarantee a syntactical correct structured output. But if the sampler is grammar aware it could.

MillionOClock 7 hours ago | parent [-]

I think both should be done, they don't really serve the same purpose.