I have thought about this many times. The same could be asked about other senses as well like taste, do we both interpret the taste of a banana the same?

At the end of the day what exactly are our senses? Are they simply our brains interpretation of the energies that surround us?

Apparently about 4.4% of the population experiences chromesthesia in which they have a blending of their senses and will see colors or shapes when hearing music.

My opinion is that it is impossible to know and if I had to bet I would bet that we all experience things slightly different. That is only based on the thought that from an evolutionary standpoint we already have many diverse traits from one another. It's another one of those philosophical thoughts we most likely could never answer.