But what exactly does this product do that you can’t from just parsing the stream?

Besides, the problem with hallucinations is the unknown unknowns: if what you’re doing is easily verifiable (like parsing JSON or checking valid chess moves) it’s trivial. But what if you don’t know the answer yourself? Then it’s basically impossible to solve.

Yes, you are absolutely right, my works only demonstrate how to catch the hallucination in realtime in case we know what kind of hallucination with clear definition.

To detect those unknown hallucication is a very hard problem. If you dont know the target, how do you shoot it.