> there will be a point where we will not trust human input without counter check by AI

That's nonsense. There is zero reason to believe that AI (with the current techniques) will ever become reliable enough to let it do its own thing, let alone better than a human. It's been years of development and you still can't trust it to get basic facts correct, not even "well it's better than it used to be". Saying it'll replace humans in 5-10 years is a fantasy (or a prediction that people are stupid enough to fall for hype, I guess).

You come from the principle that humans are reliable at first which is partly right but also wrong in so many scenarios, you can even see lately the CVE spree happening, which demonstrates that human-made codebases have serious vulnerabilities and without the help of AI, we probably won't even know about them which proves that humans are not that "reliable", the current societal structure is also built around the fact that humans can't really be trusted, nothing really different with AI, we can't fully trust them like we can't fully trust humans.

It's not a fantasy, I would bet that no serious engineer nowadays is putting in prod a codebase not AI reviewed meaning we already can't work on our own, we must factor in the on-going decline of human capabilities (at least developers) as well of course.

I'm not really saying this because of any sort of hype, but I can personally relate where I went from actually coding to NEVER CODE in less than 2 years, and everyone around me is the same thing, what it will be in 5 years?

Knowing that really, most developers aren't even using proper tooling yet so they are very slow compared to what they could be, I mean how many people we hear saying they can't even saturate an Anthropic Max 20 subscription? I saturated 7 accounts the last 2h alone, it's because they haven't entirely rethought their workflows yet, why do they even have "downtimes", it should be 24/7.

> It's been years of development and you still can't trust it to get basic facts correct

There's the rub: AI is not an oracle. It's neither designed nor intended to provide accurate recall of all facts. It's closer to a reasoning engine than anything IMO.

Oh, and for the record: I don't trust people to get basic facts correct, either. It's already far better than the average human at trivia.

It can spot mistakes made by a human if asked to review code or write tests.

GP is is over the top ins saying humans will "be inferior soon" but AI can be a nice additional check so AI review might be come standard.