Remix.run Logo
▲ himata4113 an hour ago

Fortunately they can escalate to a generally intelligent model, opus deception benchmarks are approaching 0%.

▲modeless an hour ago | parent [-]

Still, all instances of Opus are identical and do not learn. As long as the rate of mistakes is nonzero, my point stands.

▲himata4113 40 minutes ago | parent [-]

I believe that still reduces the workload by a huge factor as you would need a lot less people handling approvals, besides inverse is true agents trained in detecting deception might outperform human verifiers (two agent system). If a model can hold up to attacks for a long period of time the approval process can be automated as well, but this would have to be a very slow rollout spanning more than a year.