I mean it makes sense. Keep in mind that:

1. There's a lot of competition in many elite fields, and a decent percentage in both groups aren't going to make it anyway.

2. Being good at something as a child doesn't mean that's your passion or the thing you want to devote your life to. Plenty of these prodigies may want to get into different fields they're not naturally gifted at instead.

3. Being really good at something as a kid can make it hard to learn the discipline needed to stay on top when things get tougher. I'm not a prodigy, but many of the things I did well at in school/college are things I did worse than expected at in unversity, since I wasn't motivated/disciplined enough to get everything done on time.

4. Some fields require physical capabilities that a child prodigy may not grow up to have, like certain sports.