Remix.run Logo
▲ gfody a day ago

"clean" means not hopelessly incomprehensible which is/was the prevailing consensus among interpretability researchers

the idea that most inexplicable circuits start making sense through the lens of recursive generalization seems intuitive to me for image diffusion models but I'm not so sure about language models because of the "once removed" nature of them - I haven't made it to the bottom of the article yet so maybe this gets addressed