If I understand the paper correctly, it does not really argue against highly capable general AI. It argues against conflating capability with phenomenology.

That makes me wonder whether “AGI” is doing too much work as a term. In common usage it often evokes something like HAL 9000: a capable system that is also a subject. But the paper seems compatible with a future of very general, very useful AI systems that are not conscious subjects at all.