> if they are part of the training

That would be an intentional poisoning of the models with biased or outright untruthful data.

I believe that many people would be unwilling to use such models.

They won't be if the models are "free", which is the case for AI Mode in Google Search. That's why common people still use Google despite it being an ad-ridden slopfest, it's "free"!