This is basically what I believe, too. Its outputs are generally syntactically correct human-language sentences, but semantically, and especially at higher levels of abstraction, it is no longer correct to think of them as human language.

I agree, and am personally split, it being a sign of some "takeoff" curve or model collapse, incipient.-