Remix.run Logo
▲ fwlr 34 minutes ago

Not just “basically the same”, it is literally the same result[0,1], except here the models without the flaw just so happen to be “smaller models from the same family”… and presented before the flawed-and-patched model result, along with a conceptual framework that tries to spin this as a capability “emerging at scale”.

Since the paper is also wholly and excruciatingly LLM-generated prose, it is unclear whether the author is trying to pull a fast one on his audience, or the author’s chatbot pulled a fast one on him and he is unwittingly relaying this to his audience.

0: Transcribed from the paper:

  The same task and tools for
  Qwen3.5 2B
  Qwen3.5 4B
  Qwen3.5 9B
  Qwen3.5 27B
1: Transcribed from the paper:

  (c) The same problem, the same seed
  “... If the base were changed to four you would count as follows: 1,2,3,10,11,12,13,20,... The twentieth number would be:”

  Base model: no answer, cut at 16,384 tokens
  “... I will write the response.
  I will write the response.
  I will write the response.”

  After its own edit: 110 (correct) 5,341 tokens

  “... The 20th number in the sequence is 110.”