Honestly, I don't feel the least bit of excitement here and I'm normally enthusiastic about AI.

Yes, this generates probabilities over a set of given options instead of the whole token vocabulary.

I don't see what's so exciting about it, compared to regular LLMs which support structured output options in the API.