| ▲ | Show HN: I built a small audit layer for LLM-as-judge decisions(github.com) | |
| 2 points by ML0037 7 hours ago | ||
I made this while checking model graded answer and helped me to check the odd cases by hand. Not sure if it’s useful to anyone else. TL;DR: it breaks an LLM judge run into claims->evidence->verdicts and flags when a verdict is not supported by the evidence, so i can check it manually. | ||