Remix.run Logo
▲ fwipsy 5 hours ago

> a way to scan the model weights for backdoors

The AI safety folks have been working on a way to verify model behavior more generally. The term I've heard is "mechanistic interpretability" and it's actually really hard, though there's been some progress.