I myself have wondered why VisionOS Safari wasn't more leaning into the idea that the DOM has semantics (e.g. <header> <footer> <nav>) and CSS is already able to convey depth information.

I love the idea. Good luck with the project. (I maintain a <stereo-img> web component, see https://stereo-img.steren.fr/, and I had fun adding Ray tracing to DOM elements: https://rtx-on.steren.fr/)