Eventually LLMs will decide between life and death, heck, they are doing it already. People take the outputs seriously
Health insurance companies are using LLMs to find reasons to deny care (never to approve it)