> I think the decision was made because the people making this decision at Anthropic are well-intentioned, driven by values, and motivated by trying to make the transition to powerful AI to go well.

The entire problem is that this lasts as long as those people are in charge. Every incentive is aligned with eventually replacing them with people who don’t share those values, or eventually Anthropic will be out-competed by people who have no hesitation to put profit before principle.

I mean, yah. How else could it be? Xerox, GE, IBM (1990 Gerstner) and a zillions of other rock stars fell hard. And had to be over hauled. Thats why continuous improvement is a thing, and why a platonic take on the world was never a thing.