Remix.run Logo
Show HN: VetoBench – benchmarking AI memory beyond retrieval(github.com)
2 points by mart1adelina 4 hours ago | 2 comments

VetoBench is an open-source benchmark that measures whether AI agents repeat engineering decisions a team has already rejected. Instead of evaluating retrieval accuracy, it evaluates decision quality: does the agent propose a previously vetoed approach, and does it recognize when a memory is no longer valid? Everything is reproducible, including the benchmark, fixtures, and evaluation results. Feedback is very welcome.

mart1adelina 4 hours ago | parent | next [-]

[dead]

radu_buss 4 hours ago | parent | prev [-]

[flagged]