I remember the infamous 300ms delay on tap when smartphones first came out.

It matters!

There is some number of fps where "the human eye can't tell the difference" I bet there is one for ms delays