Doctors oversight should be removed (not as an option, but as a requirement) for 90% of all prescriptions. Unless the drug has externalities like antibiotic resistance, is heinously addictive, or is so difficult to administer correctly that you cant take it outside of a hospital, there's no good reason to tell people what they can't put in their bodies. Whether or not your insurance will pay for it without a prescription is another matter.

This is not an argument that has any relevancy to AI. If anything, someone who believes what you say should be against the introduction of AI into the system because your argument is fundamentally that these drugs shouldn't have a gatekeeper. Swapping out one gatekeeper for another, especially with the new gatekeeper being the unknown black box of some AI middleman, won't actually address your complaint.