I think the big assumption that this article hinges on is that AI will never create durable code. That cannot be true. Now that we’ve finally got a taste of the singularity, humans will never stop trying to bring about AGI, which by definition must write code that is exponentially more durable than anything a human could write. The question is ‘when’.

> The question is ‘when’.

Why ?

In the 60s we thought we'd be living on the moon and mars "soon", flying cars were talked about seriously, that faster than sound jetliners were just around the corner, &c. Sometimes what's possible isn't desirable, or what's desirable isn't possible. No one went back on the moon, space programs are basically dead, planes are still as slow as they were in the 50s, a 747-8 from 2008 isn't much faster than a 707 from 1956

Just because you dream of something does not mean it will come true

Never stop trying != succeed

You've wandered away from logic into the realm of wildest fallacy. Your proof about AGI is just a repurposed proof of the existence of a supreme deity! In other words your argument is, "AGI will be the literal most amazing thing in the universe because that's what I define the word AGI to mean." No implementation of AGI could ever satisfy your absurdist threshold because what you want already exists. Code more durable than any written by humans is called DNA. Which DNA and which code persist throughout history is the subject of romances and wars, in other words the stuff of life and death. Only by being wilfully blind to literally everything in the world could you be so ignorant as to believe that you've found some great blank empty slate where nothing yet exists. Sorry, but this space is inhabited already.

The question remains, 'can it be done'.