Imagine a giant trawling net scooping up the last two-three decades undeprecated of work on the web/data/game/operating system space and cutting out the people who did all that work. What do you think is going to happen to the progression in those areas? I guess it was "done"? The LLM AI is only as good as its input, as far as I can tell there is no reason to believe any of its second order outputs. RLHF is an interesting plug for that hole but its only as good as the human feedback and even then those things taken to second order aren't going to be any good. This collapses the barrier to entry to existing products, aka those people are going to be swamped with new competition.