Remix.run Logo
Show HN: I built a small audit layer for LLM-as-judge decisions(github.com)
2 points by ML0037 7 hours ago

I made this while checking model graded answer and helped me to check the odd cases by hand. Not sure if it’s useful to anyone else.

TL;DR: it breaks an LLM judge run into claims->evidence->verdicts and flags when a verdict is not supported by the evidence, so i can check it manually.