There are physical tests and people do get disqualified.

Yes, and women are not prohibited from taking those tests simply because they are women. Indeed, many women qualify.