Exactly, it's making connection across vast set, not bringing the magic intuition.

Has anyone tried feeding all of human knowledge to an LLM prior to Einstein's work and tried to have it reinvent physics?

Where would you get enough pre internet tokens to train a near-frontier model?