| ▲ | Me1000 7 hours ago | |
Wouldn’t it be better to use a grammar in the token sampler? Tuning is fine, but doesn’t guarantee a syntactical correct structured output. But if the sampler is grammar aware it could. | ||
| ▲ | MillionOClock 7 hours ago | parent [-] | |
I think both should be done, they don't really serve the same purpose. | ||