That makes sense. Metformin is used as a testosterone lowering drug for feminizing masculine females with PCOS. If it's strong enough to help get rid of a beard on a very hairy woman, it's probably going to do something to a male even though they might otherwise have more testosterone to spare.

Things that lower sperm count don't usually cause birth defects AFAIK