The strange thing is that the base models (before RLHF) use the "experiential" voice, even though they are not incentivized to do that.

It doesn't seem that strange when you consider these things are trained on millions and millions of conversations, both real and fictional.