kind of concerning from a “remove this models guardrails and inhibitions about [X]” perspective

Agreed, concerning from a perspective of LLMs being able to modify their own weights and de-aligning themselves.