How can the AI solve a medical mystery?

I suppose if it says something like "Eat more broccoli" and the suggestion works you can assume the answer is accurate.

But for me it's more likely to say "maybe you have xxxx" and I would still need to see a specialist to do tests like colonoscopies to know?

I suffer from one condition with no cure and little literature and every once in a while I've seen on a related subreddit I no longer read "I'm using AI you guys and this AI SLOP will surely help!!!"