That’s not what people are worried about, it’s the rigging of real world events (including wars!) that has people worried.

It's also a bit overblown. If you could rig a war, you would stand to make a lot more money playing the stock market than small potatoes prediction markets. A lot of money has been on the line based on which party wins elections even before prediction markets existed (see fracking or pipeline project approval as obvious examples).