But this use isn't specific to the Vision Pro, or am I wrong? What prevents things like that from running on any other VR headset, like my half-broken Quest 2?

It's not. I did a walkthrough of a Sketchup model of my home using Oculus Rift almost exactly 10 years ago.