Very well said.

And when you say it like that, I have to wonder how much of this is a natural consequence of RHLF on such a grand scale, when you have millions of people pretty much much skimming chat responses or operating outside their depth and giving unqualified feedback to the models.

Seems like a lot of people may be reinforcing what sounds smart over what is smart.

Also as an aside: funny how much the LLMs continue to mirror the human communication they’re trained on