| ▲ | himata4113 an hour ago |
| Fortunately they can escalate to a generally intelligent model, opus deception benchmarks are approaching 0%. |
|
| ▲ | modeless an hour ago | parent [-] |
| Still, all instances of Opus are identical and do not learn. As long as the rate of mistakes is nonzero, my point stands. |
| |
| ▲ | himata4113 40 minutes ago | parent [-] | | I believe that still reduces the workload by a huge factor as you would need a lot less people handling approvals, besides inverse is true agents trained in detecting deception might outperform human verifiers (two agent system). If a model can hold up to attacks for a long period of time the approval process can be automated as well, but this would have to be a very slow rollout spanning more than a year. |
|