Where is the information going to come from though? LLMs aren't primary sources, they consume and regurgitate.

I guess/hope that's where Yann LeCun and their proposed "world models" etc are going to fill in :)