Risks:

Changing parameters on the insulin pump because the LLM said so

Neglecting to seek actual medical advice believing a LLM replaces it

Misunderstanding medical complexity (ie a prescription due to medical history not available to the LLM)