| ▲ | abecedarius an hour ago | |
The usual meaning: say you have an interpretability signal that reveals reward hacking or other badness. Your most obvious response is to use that signal as a penalty in training. Doing that is called "the Most Forbidden Technique" because you can expect it to degrade the signal without stopping the badness. But this doesn't seem to describe the OP, it's a different way to lose monitorability. | ||