> The point being: humans seem to me to be the weak link here.

I tend to agree but it is hard to shake the feeling that there is a larger system in play that the humans are just a component of. And that system is making the decisions.

Historically that whole thought was just a philosophical curio because the decision making parts of the system had to be powered by humans. But what we're discovering as AI improves is either we've hit AGI or humans are actually incapable of performing any act that demonstrates intelligence or autonomy.

As we build systems where the drive and decision making stems from computers, it does seem that we will have to revisit the concept of humans being the problem.

"I tend to agree but it is hard to shake the feeling that there is a larger system in play that the humans are just a component of. And that system is making the decisions."

That system is "the economy". Which, clearly, doesn't have humanity's best interests in mind.