I think this is just humans not understanding things and irrationally being afraid of one thing more than another thing. You're afraid of someone listening to you; you're not afraid of someone copying the documents that detail every single aspect of your health (EHR records).

Healthcare records are probably the most strongly protected personal information in the world. Remember that most of the data about you is not protected by law. Credit reports, ISP records (including your SS#), your entire email archive, Google Drive, etc could get leaked, and for the most part there's no legal consequence. But if a record of you having the flu in 3rd grade gets leaked by a 3rd party connected to health record keeping, there are real consequences (not only for the leak, but even for not reporting it).

If anything, I want everything I say to be recorded and kept on file for later reference. The danger of speech-to-text engine transcribing incorrectly is real, but that doesn't mean I don't want the notes there. I just want the audio included with the text. Both will be useful to refer to later on, especially as STT models improve their accuracy (we've seen amazing leaps in accuracy in just 1 year).

However, we do need to ensure that these records are protected from government over-reach. Currently the government can request your health records, without notifying you, for a slew of reasons. This enables the government to go on a fishing expedition, doing the equivalent of an unreasonable search of private information, and you will have no notification and no way to respond. We must create laws that provide stronger privacy rights for sensitive health information to resist government overreach. Another legal hole is 3rd party apps that collect sensitive health information, but aren't provided by your doctor. Your step-tracking, heart-monitoring app is not protected by HIPAA. Same for employer health records.