Remix.run Logo
brcmthrowaway 5 hours ago

This makes me very sad

If Qwen and other Chinese labs are just copying reasoning traces, then those labs are more than a year behind the frontier.

levocardia 4 hours ago | parent | next [-]

It's been pretty obvious to me that the Chinese labs are operating mostly on a fast-follow strategy. The distillation attacks are well-documented, and there is good reason to believe they are able to copy architectural innovations as well. If US labs stagnate I would expect Chinese labs to stagnate as well. Their engineering is great, but in terms of frontier innovation (which requires heavy compute to search for new strategies that work at frontier scale) they are very far behind.

jarym 3 hours ago | parent [-]

Japanese electronics started off the same way post-war.

Roland303 11 minutes ago | parent [-]

well then theyll be do better post war, just in time for fallout timeline

atomicnumber3 4 hours ago | parent | prev | next [-]

It makes me happy because it means that these misanthropic technofascists have no moat. They can spend trillions of dollars only for it to be largely copied in short order.

Even if they weren't political adversaries of freedom, I would still feel 0% bad given all their training is already on data they got for free.

Information continues to want to be free. To the benefit of us all.

vipa123 4 hours ago | parent | next [-]

Preach brother, they stole everything on the internet, and beyond, to train their models. They thought all that information was free, and everyone a few months beyond them is just following their example.

polotics 4 hours ago | parent [-]

They didn't actually steal in the sense that the information is still there on the internet.... About these shredded rare books, now we're talking.

If I may propose instead of "steal" I think we could agree to write they "Aaron-Swartz'ed" the information from the internet, what do you think, is this too harsh on Sam Altman or Carmen Ortiz ?

vipa123 4 hours ago | parent [-]

Is anything too harsh for these new robber barons?

9864325789976 2 hours ago | parent | prev [-]

Oh, we got a real rebel among us.

Daishiman 4 hours ago | parent | prev | next [-]

The way I see it the Chinese labs are optimizing for other things, including effective compact models that don't need to run on top-of-the-line nVidia hardware.

nater5000 4 hours ago | parent | prev [-]

Well, yeah? I didn't think anybody seriously thought otherwise?