The status quo is people googling shit, finding either legalese they can't understand (but maybe think that they do) or information that was legitimate ten years ago (and is dangerously inaccurate today). If I ask a question and get an answer that's been inaccurate for years I'm going to have as much or more false confidence as an AI bot that misunderstands the source. The difference is the AI bot gets better with time instead of worse. It may not be perfect but it's a step in the right direction: Let them cook.

No, someone who gets a bad answer from a random source is not going to have as much false confidence as someone who gets bad advice from a .gov domain.