This rests on the assumption that AI can't do weird stuff.

I think it depends.

For measurable goals and simulatable systems, AI and other methods like evolutionary optimization can create weird things on their own.

But what if the goals themselves are weird? This exists, There's a niche for that in the economy, but it's pretty small.