I don’t really have a strong opinion one way or the other about your overall point, but I just want to point out for clarity:
Examples like Judit Polgar (who was around the top 10 players in the world at her peak) do indeed prove that chess is nothing like (physical) sports in this way. In physical sports like basketball, soccer, etc. the best women in the world can’t compete against even moderately athletic amateur men. A famous example is the fact that the US women’s national soccer team practices against young teenage boys (and routinely loses). In chess it would be like if the best woman was rated 1800 or something.
This isn’t meant to disparage women in sports — they really do have a categorically different kind of body from men, and pushing those bodies to their limits is just as impressive as it is for men. But they don’t appear to have categorically different kinds of brain, at least insofar as it matters for chess skill.