I dont know if i fully agree to it. ppl are still trying to find the aspects that AI do not handle (or do very well) yet, to define the irreplaceable value of human (humanity?), without realizing that these abilities/capabilities are within the expanding range of AI soon if not tomorrow. Why would one assume that (99.99% of) human can solve the issues that AI can not?

should we stop treating the idea that humans must possess some capability AI can never replace as the starting point for discussions about humanity's future?

I'm inclined to think we should.

Preserving human agency is a moral and institutional choice, not something that needs to be justified by human cognitive superiority

I think people can solve real-world problems better than LLMs including through code. A UX designer is gonna design a better UX than an LLM, but a worse one than a programmer with UX design skills, because the tacit knowledge of your users workflow and a good mental model of your codebase can be synthesized into a more cohesive experience than with top-down planning.

It's the problem of delegation: you can do more of something, but worse, the more people you bring in. LLMs are just a very cheap contractor with a zero liability clause and some unchecked sycophantic tendencies.

> should we stop treating the idea that humans must possess some capability AI can never replace as the starting point for discussions about humanity's future?

> I'm inclined to think we should.

Mate, I think we're not even invited to the conversation. A small group of people are planning humanity's future and they're going to inflict it on us whether we like it or not.

You know, unless someone stops them somehow.

>Preserving human agency is a moral and institutional choice

The issue is that what's considered "moral" by the majority of society does not stop those already in power from doing as they please (the institutions).

There is a fundamental inequity that exists in our society that allows those with more to have an outsized vote in determining how the finite resources (human/land/capital/etc.) on this planet are distributed.