> naturally occurring genetic outliers among men unrelated to gender

This is just not true. Many sports are categorized by weight for the most obvious example.

Yes. Which is what I proposed for all differences. Note that classifying by weight is not banning athletes like is happening in the olympics.