I recently had a discussion with a sibling -- not an old person -- who was taking medical advice from ChatGPT. They were like "we should X because ChatGPT", "well, but ChatGPT ...". I could hardly believe my ears. Might as well say, "well, but someone on Reddit said ..."

And this person is fairly savvy professional, and not the type of person to just believe what they read online.

Of course they agreed when I pointed out that you really can't trust these bots to give sound medical advice and anything should be run through a real doctor, but I was surprised I even had to bring that up and put the brakes on. They were literally pasting a list of symptoms in and asking for possible causes.

So yeah, for anyone the least bit naive and gullible, I can see this being a serious danger.

And there was no big disclaimer that "this does not constitute medical advice" etc.