I think it's a mix across the different kinds of people.

For me my car isn't loud right now, but I do just genuinely enjoy the thrill and sound of the car in "track" setup. It's too loud to drive on the street but it's a thrill on track. The loudness isn't the point and I wish it were quieter, but the different exhaust components give it the raw visceral sound that I love.

I guess you can think of it like the difference between music on the TV or music at a concert, the sound is literally different not just louder, and the context makes everything more visceral.