Remix.run Logo
libraryofbabel 3 hours ago

Unless you have evidence from a mechanistic interpretability study showing what's happening inside the model when it creates comments, this is really only a plausible-sounding just-so story.

Like I said, it's a trap to reason from architecture alone to behavior.

energy123 an hour ago | parent [-]

Yes I should have made it clear that it is an untested hypothesis.