Remix.run Logo
7734128 5 hours ago

Sure, but TFA is trying to use Qwen's reaction to the thoughts as proof that they did indeed extract thoughts to train on.

My point is that any model trained after August 10 will know of those specific thoughts.

refulgentis 4 hours ago | parent [-]

I'm sorry, it's going over my head still - my reading is "all models with any training after August 10 know how GPT 5.5 Pro thinks", but I'm not sure why - my initial guess was that's when GPT 5.5 was released, but that doesn't seem to be the case (it was released April 23rd).

7734128 4 hours ago | parent [-]

They would know the specific thoughts released by the "stolen thought" paper, which became part of the public internet on August 10.

Unfortunately those are the only thought examples you can use to perform this experiment, as no other are availible.

But as the model should have seen those specific examples, it's not a good signal that Qwen was exfiltrating thinking traces.

irthomasthomas 3 hours ago | parent [-]

Has the method for extracting the COT been blocked, now? Otherwise why could we not generate some fresh samples?

7734128 3 hours ago | parent [-]

I'm not sure how viable it still is. Perhaps it's still possible, and perhas that's exacly what they did in wtich case my objection falls, but I don't know.