This. People who care about animal cruelty dont go building largest ever meatfarms and slaughterhouses.

People who opposing arms manufacturing and gun violence dont jump to work for gun companies.

People who really want AI benefit all humanity dont stick working with lying CEOs who want to convert company from a non-profit.

Etc. So many examples.

One major source of conflict in AI policy / AI safety is that very smart people have radically diverging intuitions about how dangerous superintelligence is and how difficult it is to align.

A first group dismisses the problem entirely, saying intelligence != power and AI doesn't have "drives".

A second group believes that alignment is solvable through engineering and iteration, and that we have the best chance of surviving if people with the right intentions are the ones working on it.

A third believes that aligning a superintelligence is a unique category of problem, that we are nowhere close to the level of scientific understanding needed to achieve it, that we only have one shot (because once a sufficiently powerful superintelligence exists it will thwart all future attempts, and alignment techniques that worked on dumber AI will likely not work on it), and that the world will have to coordinate to avoid killing ourselves off by building superintelligence before we understand how to do it safely, the way we have coordinated to avoid nuclear war.

The Anthropic and OpenAI founders, Elon, and Anthropic engineers are mostly in the second category. Some safety people at Anthropic and OAI are in the third category, but leading people in the third category think that pure safety roles at the labs are potentially impactful enough to be worth not quitting.

> Obviously their statements are insincere, because they are building the bloody things. If they were sincere that AI is like nuclear weapons, then they would be devoting all their cash and energy into lobbying the government to nationalize them...

This comment makes no sense. Id you think this tech is dangerous and happening soon and clearly they think the safest way to have it releases is to do so first and model safe ways of doing things. Clearly we cab agree or disagree it's internally consistent what they are doing and aligns with their statements.

And you and OP think the best way to be first to release this is tie all of their funding for the exponentially growing expense is to they notoriously slow moving, bureaucratic government includinf funding process? And the best way to develop it is to directly tie their fate to this notoriously capricious administration?

These comments make no sense. Even if you're completely against Anthropic those comments make no sense.

They don't stick working for sama, they split off and found Anthropic.

I oppose gun violence and I would go to work for a firearms manufacturer.

I oppose nuclear war, and I would go to work in the supply chain for nuclear weapons.

Deterrence and game theory are very real.

It's the narcissism.