"Missing out because my parents are lame" is a minor social stigma that kids will (should!) experience in many situations anyways. The benefits significantly outweigh the drawbacks.