I have been using structured json outputs since gpt 4 days. Never understood this jev hype
i think the main deal is speed right?
No, the main deal is that it CANNOT answer with anything outside the given structured options. LLMs can go off the rails, however small a chance it is. The architecture behind JEV and the like doesn't let it do that.
> structured json outputs