You do you but as a cyclist you are super vulnerable to all manner of things and I'd never want to give up that kind of awareness.

If you listen carefully you can usually hear a cyclist behind you who may want to pass or is passing you, and having headphones probably makes that a lot harder