Remix.run Logo
▲ johnnyApplePRNG 4 hours ago

No offense but you don't know what you're talking about.

Spitballing random pr pieces from companies about to IPO is not helpful to anyone, fyi.

▲jamienk 4 hours ago | parent [-]

I'm anti-Anthropic and think their accusations are total PR FUD-packing. They don't focus much on the cc fraud because their PR firm landed on pushing the (tech-sounding) word "distillation" to try to scare people in the US and to try to make it a geopolitical issue where trade negotiators can put pressure. The Chinese companies see an advantage in being "open" right now, and it is working. They will not stay open once they see an advantage there. (Contrast with GNU.)

But I've slowly come to realize that AI+"dark resources"(scare quotes)=something bad! And this is imminent (maybe I'm naive and it is already ubiquitous).

We see here, with Kimi, that there's growing traction with the idea of eliminating types of training to avoid evil. I'm skeptical of that.

▲qwe----3 2 hours ago | parent [-]

Have you trained models? If not then you can't really speak to how effective distillation is (answer: it is very effective)

▲randbyte 2 hours ago | parent [-]

lol. Have you? What kind of distill you are talking about? It’s only effective in the surface, small scale model or output preference. Not useful for long reasoning chain.

▲google234123 an hour ago | parent [-]

Yes. And your last statement is false