Instead of trying to decide one animation speed for all things, the UI should be adaptive. The author stumbles onto this and walks right past it: whatever raycast is, they use it a lot, and find the animation (any animation) annoying.

The UI should learn the user's patterns: when they're new and unfamiliar, the animations are slower and more deliberate, instructional (initially including more information re: expected workflow). As the user "walks" a certain path again and again, every time more smoothly and confidently, the suggestions / assists / animations diminish, shorten, and disappear. For a pro user with muscle memory and memorized keystroke sequences, the UI does its best to just get out of the way.