Then this is actually much closer than previous headsets?

There is a lot going on to render the desktop in a tracked 3D space, all that has to happen somewhere. If you're expecting to plug a HDMI cable into a headset and have a good time then I think you're underestimating how much work is being done.

OpenVR and OpenXR are really great software layers that help that all work out.