>but LLMs are not animals, animals learn from experience and LLMs don't.

I mean they kind of do by distilling said experience and putting it in the next model.

Current LLMs can't do it because building said world model is super expensive, anything that lowers that requirement brings us closer to continuous learning.

Also the models we train these days are typically generalized human text models. Animal models are a bit different because they won't be "word" models and they aren't going to be generalized text models like us humans use. In fact there is a story just today on HN about a user creating some rather simple transformer models to solve a number of the Arc-AGI problems not using (human) words at all. The reason you don't see more of this is most people aren't dumping compute into these kinds of issues, but instead going for the AGI prize.