I have a problem with animation every time it induces latency. It's okay to animate some action that would take that much time anyway, but waiting for purely cosmetic animation to finish feels sluggish and not enjoyable.

Yes, animations are fine for things like progress bars, where they visualize something happening without interfering with user actions. But otherwise, animations should be avoided, or limited to something like 100ms.