That goes for like, most infrastructure? Who would want a dump or nuclear power plant in their backyard?

Technically people do benefit from having a dump or power plant.

Very few people are affected by having a dump nearby or a nuclear power plant, whereas it seems like the power generators for these AI data centers really belong in an industrial park.

These data centers also don't employ many people, though I've read they are wonderful for city taxes, assuming they haven't gotten too many enticing tax breaks.

Pretty much nobody, but dumps and nuclear power plants are in the same category as things like airports and sewage treatment plants that provide services that are largely used in the area the service provider is in. You may not like a dump nearby, but hey, your area needs those services and the providers have to be in the area, and at least a dump is better than a sewage treatment plant.

AI data centers are not in that category. Nothing AI is going to do (good or bad) for 99.9% of people requires that the data center that AI is running in is in the same area, or even the same state. It just needs to be somewhere where the internet latency between them and the data center is not too high for whatever they are using the AI for.

I’ll take the nuclear power plant, as long as I’m far enough away to not hear anything from it.

Folks don't want anything built near them ever. Even if it's as benign as housing.