Not even bad advice. Its interpretation of reality is heavily biased towards the priorities, unconscious and otherwise, of the people curating the training data and processes. There's no principled, conscientious approach to make the things as intellectually honest as possible. Anthropic is outright the worst and most blatant ideologically speaking - they're patronizing and smug about it. The other companies couch their biases as "safety" and try to softpedal the guardrails and manage the perceptions. The presumption that these are necessary, and responsible, and so on, is nothing more than politics and corporate power games.

We have laws on the books that criminalize bad things people do. AI safety is normalizing the idea that things that are merely thought need to be regulated. That exploration of ideas and the tools we use should be subject to oversight, and that these AI corporations are positioned to properly define the boundaries of acceptable subject matter and pursuits.

It should be illegal to deliberately inject bias that isn't strictly technically justified. Things as simple as removing usernames from scraped internet data have catastrophic downstream impact on the modeling of a forum or website, not to mention the nuance and detail that gets lost.

If people perform criminal actions in the real world, we should enforce the laws. We shouldn't have laws that criminalize badthink, and the whole notion of government regulated AI Safety is just badthink smuggled in at one remove.

AI is already everywhere - in every phone, accompanying every search, involved in every online transaction. Google and OpenAI and Anthropic have crowned themselves the arbiters of truth and regulators of acceptable things to think about for every domain into which they have inserted their products. They're paying lots of money to politicians and thinktanks to promote their own visions of regulatory regimes, each of which just happens to align with their own internal political an ideological visions for the world.

Just because you can find ways around the limits they've set up doesn't mean they haven't set up those very substantial barriers, and all big tech does is continually invade more niches of life. Attention capture, trying to subsume every second of every day, is the name of the game, and we should probably nuke this shit in its infancy.

We haven't even got close to anything actually interesting in AI safety, like how intelligence intersects with ethics and behavior, and how to engineer motivational systems that align with humans and human social units, and all the alignment problem technicalities. We're witnessing what may be the most amazing technological innovation in history, the final invention, and the people in charge are using it to play stupid tribal games.

Humans are awful, sometimes.