Remix.run Logo
throwaway_7274 an hour ago

I think it’s no longer speaking human language. It used to, when it was mostly or entirely trained with imitation learning of human-generated text. Now it’s increasingly trained with RLVR, and there’s far less optimization pressure on actually speaking English (or Punjabi or Mandarin). It still uses English words and syntax in its output, but the semantics are drifting more and more. It’s basically speaking in a code that superficially resembles English.