Agree, but then throw away (or only have them as backup) the notes during the actual talk. Find the sweetspot where you've practiced enough that you remember all the content and how the different parts flow into each other but haven't yet memorized your script entirely.

I once read a book that could have been a pamphlet or maybe a paragraph that boiled down to “Don’t have a script you memorize, but do practice over and over and over and over and over until you feel entirely comfortable with the material”. This made an enormous difference in my ability to give talks.