Doesn't it prove GP's point then, that LLMs themselves simply aren't capable of creating/proving new theories and axioms?

Without passing opinion on GP's point, I think that just proves it's hard to establish a data set that doesn't bias toward the result you're hoping to find.