Remix.run Logo
top1aibooster 3 days ago

> Here's something most developers overlook: if an LLM has a 2% JSON defect rate, and Response Healing drops that to 1%, you haven't just made a 1% improvement. You've cut your defects, bugs, and support tickets in half.

If part of my system can't even manage to output JSON reliably, it needs way more "healing" than syntax munging. This comes across as naive.

Dylan16807 3 days ago | parent | next [-]

Plus, that claim isn't even true. A 1% and 2% JSON defect rate are going to annoy a similar amount of people into filing bugs and tickets.

fhcuvyxu 3 days ago | parent [-]

1% fail rate on API requests is horrifyingly embarrassing.

0cf8612b2e1e 3 days ago | parent | prev | next [-]

Sounds like we are twice as close to AGI!

01HNNWZ0MV43FF 3 days ago | parent | prev | next [-]

"it's not just X, it's Y"

Don't you worry about Planet Express, let me worry about blank.

Spivak 3 days ago | parent | prev | next [-]

Model itself can't output JSON reliably. It's on you building a system around the model to make sure it either returns correct output or errors which is trivial to do.

arm32 3 days ago | parent | prev | next [-]

But, but, you've just cut your defects, bugs, and support tickets in half!

Cheer2171 3 days ago | parent | prev | next [-]

[dead]

spwack 3 days ago | parent | prev [-]

[dead]