Fair.

Getting a correctly sized light shield helps a lot as it balances the weight over your whole face. Also helpful is having the strap ride a lot higher on the back than you would think is right -- it always feels way too high, but is held in place better when I do this, and feels lighter (as some of the strain is taken off the face).

Or using the alternative over-head strap. This is one case where I think Apple went too far with form over function. There are much better strap designs, but they just aren't aesthetically pleasing I guess?

Finally, I generally use it laying down in bed or on a couch, which makes the weight less of an issue.

I agree in principle that a lighter device would be vastly better. I don't know how they will get there without drastic improvements in the underlying technology though.