It might be weirder, but part of human intercommunication issues lies in the fact that people live with very different representation, though they can be supposed to live in the same single encompassing one. They don't all experience all of the world and even when they share some common experience they went through, they didn't experiment them from the same ground and previous experiences do influence current and future interpretations.

I expect an immense degree of representational similarity to exist between humans.

You're making a mistake there - focusing on the tip of the iceberg without considering what lies beneath it.

The bulk of what the human brain does isn't "decide whether skub is good or bad". The foundation that the human cognition is built upon is vast, and mostly invisible from the inside. You don't get to see the feature matching operators of your visual cortex, or the patterns that decide whether a sound is "soft" or "sharp". And a lot of those foundational features are assembled by biological development programs spun up all the way from DNA.

On that level, when it comes to the bulk of neural circuits and the processes implemented by them, the representations within a "Pro Skub" and an "Anti Skub" guy might easily be 90%+ compatible. The two people who had vastly different life experiences, worldviews and opinions would be more alike to two different LLMs fine tuned from the same base model than they would be to two different architectures trained on completely different datasets.

I don't think neural networks have the same ability of self deception as humans do. A huge reason human world models vary so much is due to them being tied to tribal membership. A huge fraction of all people will not come to a rational worldview derived from accurate data but will start with their tribe's worldview and filter data to match. I personally have never modified my worldview for social reasons and it is surprisingly isolating.