Dismissing the entire technology as "next token prediction" is also silly. It's implying we actually understand LLMs to a great degree when we do not.

I think a little bit of humility for the capability of these machines is warranted at this point.

LLMs are next token predictors in the exact same way that a rogue paperclip maximizer in the process of defeating the US military is a paperclip making machine.

You might as well describe the primary purpose of a for loop as incrementing a counter. It's what it does while incrementing the counter that actually matters.

I'm not dismissing the tech! I think the tech is cool and useful! It is sci-fi levels incredible in many ways.

But it is also not some mysterious force beyond mortal ken and pretending it is inhibits the useful and safe application of the technology.