Remix.run Logo
▲ hypfer 2 hours ago

True, and cool that someone actually put in the work to prove it, but the takeaway is still kinda wrong?

Because it's not the abliteration that does this. It's the "untrusted artifact" that does.

Even a "clean" model of a lab could be doing this. Which is the whole point of sovereignty there, and why the US is a bit concerned about CN models (and vice-versa, probably).

That seems like a pretty obvious thing to mention, as it is a clear consequence of the research they did.

___

Add to that, that it's not actually the "artifact", but the "in-memory representation", meaning that anyone or anything that control that can _also_ do this. Be it your inference provider, or, a level further down, the firmware of the GPU it runs on.

▲serf an hour ago | parent [-]

totally agreed, and..

>, the firmware of the GPU it runs on.

that'd be a rad PoC to see, but given the gpu values right now i'll let someone else brick things.