Even if yawning in public affected sexual fitness: how long has it been socially impolite to yawn in public? Evolution takes a rather long time in species with long reproductive cycles. Almost all mammals yawn, it would take significant genetic changes to breed that out of us. That doesn't happen overnight.

400-500 years minimum (15-20 generations), although point taken