Users would hate a simple deny list, even if it may be a good idea. That means the safeguards, to the extent they currently exist at all, have to be complicated and stochastic and not interfere with growing metrics.

The industry has known it's a problem from the get-go, but they never want to do anything to lower engagement. So they rationalize and hrm and haw and gravely shake their heads as their commercialized pied pipers lead people to their graves

Claude basically had a deny list. Seems still popular enough. The other vendors just don’t care about AI safety.