I think another thing to keep in mind is that there’s probably an element of sensory adaptation at play here. Like when you wear a watch: you notice it at first, and then you don’t notice it on your wrist anymore.

So if you’re actively moving between a high-refresh-rate device (like a lot of people here with their 144hz monitors) and then one with a lower refresh rate, you’re probably more sensitive (and potentially annoyed) by the discrepancy.