> This is science fiction, these models don't have access to their own weights.

The models are being used to train, and improve the infrastructure for training, other models [0][1]. Several RL techniques rely on using the currently-being-trained weights as part of their process. I really would not take "don't have access" as a given, especially during the training phase.

> What would be a lot more scary is a model as capable as sol that's able to run on consumer hardware without taking up several terabytes of storage, but of course that is simply not possible as we need 4t parameters to even begin emulating a small fraction of what a human brain can do.

The Poolside Laguna S 2.1 model [2] purports to compete with models several times its size, and inference compute is becoming increasingly plentiful. Again, would not hold anything here as a given.

[0]: https://openai.com/index/gpt-5-6/ ("GPT-5.6 accelerates OpenAI")

[1]: https://www.kimi.com/blog/kimi-k3#coding

[2]: https://poolside.ai/blog/introducing-laguna-s-2-1

[dead]