> There are some things LLMs cannot do, or at least do well, at any size, at infinite size and with infinite compute, simply due to the very nature of what LLMs are to begin with.

How can we be so confident that there is anything LLMs fundamentally cannot do? Proving that impossibility seems hard.

Drawing trend lines far into the future is foolish, but the recent trend is clear and its not obvious how much more progress is needed before they start having a meaningful impact on more aspects of life.

> not whether they are an emerging alien intelligence with civilisation-threatening capabilities.

The people building them are explicitly attempting to do this. They may not succeed, but what if they do? Seems worth considering that scenario.