This is insane. The whole point of the modern pharmaceutical system is to ensure that people are given the medication they need, not what they want.

Knowing how easy it is to jail-break LLMs, it's conceivable that this allows a knowledgeable attacker access to whatever prescription medication the system has the ability to administer.

If a corrupt pharmacist is criminally liable for abusing their power of the pad, then someone either on the private side or governmental side of this needs to be held to the same standard for "solutions" like this.