At times the advice is genuinely helpful. However, it's practically impossible to measure under what exact situations the advice would be accurate.

I think ChatGPT is capable of giving reasonable medical advice, but given that we know it will hallucinate the most outlandish things, and its propensity to agree with whatever the user is saying, I think it's simply too dangerous to follow its advice.