this has exceedingly obvious limits. The primary limit is the context pollution that happens when you give it too much context.

Elon and the rest of AI crew who claim LLMs can just forever grow is not realistic or held out by real world testing.

It can do "everything" but by everything, it'll still be fine tuned and harnessed and agentified which isn't really the idea that the model can do everything.