I didn't really have a problem with the spoken sounds when learning in school - we were also required to take Maori lessons as well and a lot of the sounds are shared. Quite interesting really.

Edit: actually the only one I ever had an issue with was one of my homestay's names "Ryouhei"...that Ryou sound...it's like the Y stops me from rolling the R properly, so odd.