> To take Coxon's argument seriously, you have to believe frontier models are hypercapable, and not just hype objects.

It's harder and harder to make the point that frontier objects are just hype objects though. And, even if they stay where they are today, that's more than enough to make them incredibly...destabilizing, to say the least. It's not only it, but frontier models act like knowledge mixers and percolators. Some people (not necessarily everybody), are adept at the discipline of learning, building things and executing projects, and that's all you need today with LLMs filling many of the gaps such person can have. Now, most of those people are actually engineers. So I'm going to go with the article and say that we must stop selling our souls for money.

Hype objects when it comes to the idea that they will soon become recursively self-improving, boot strapping themselves to super intelligence, at which point we will be at their mercy. Because that's basically the p(doom) argument, that some probability is associated with ASI killing us all.

That's different from what we have today with powerful software tools that people can use for all sorts of things, which is an extension of what we already had in less concentrated form. It makes things easier for humans to do good and bad things, but it's not an autonomous digital god.