> I guess having too much chess data in the training set probably regressed performance

I think the theory is that the LLM having a high chess ELO was a pet project of a researcher that left.