In personal, light-hearted or even most 1 to 1 meetings I'd agree.

But my note taker has been an incredibly helpful piece of technology in professional meetings where domain decisions had to be recorded, high-throughput arguments were exchanged, ideas brought up and todos just verbally agreed on.

I always ask people, kindly and honestly with a lot of room for denial, for agreement to record meetings with them. No, I don't do it in meetings where I know personal topics could come up or be relevant. But those are more on the rare side. In most of my professional exchanges it hasn't posed a problem for anyone.