Doesn’t the loom metaphor still hold? A badly operated loom will create bad fabric the same way badly used AI will make unsafe, unscalable programs.

Anything that can be automated can be automated poorly, but we accept that trained operators can use looms effectively.

The difference is the loom is performing linear work.

Programming is famously non-linear. Small teams making billion dollar companies due to tech choices that avoid needing to scale up people.

Yes you need marketing, strategy, investment, sales etc. But on the engineering side, good choices mean big savings and scalability with few people.

The loom doesn't have these choises. There is no make a billion tshirts a day for a well configured loom.

Now AI might end up either side of this. It may be too sloppy to compete with very smart engineers, or it may become so good that like chess no one can beat it. At that point let it do everything and run the company.

Loom is a good metaphor.