If you have to really understand software development to be a good user of AI, we’re screwed. All the best users of AI we’ll ever have already exist I think.

That's a good point. Im a novice self taught developer that somehow pushed through and made a decent PM tool for the construction industry. It works, if your users aren't malicious or too demanding.

Now I'm working on a second project, all with AI. I haven't written a single line. It works better than a non programmer would make because I knew what to ask for. But I'll admit I'm not learning anything.