yes! it's the worst!

I've been using Instant Space Switcher (which got a small callout in tfa) as a targeted fix for this, and it's lifechanging