We haven’t mapped the hard limitations of LLMs yet but they’re energy bound like everything else. Their context capacity is a fraction of a human’s. What they’ll replace isn’t known yet. Probabilistic answers are unacceptable in many domains. They’re going to remain amazingly helpful for a certain class of tasks but marketing is way ahead of the engineering, again.