Yes. I do! If I'm mucking around in the water at the beach I'm in long sleeve top, hat and sunglasses.
That's wading, not swimming
Honestly, that's what I wear when swimming.