Crazy how their models always come out after the US labs and just lag the performance of top models. Almost like they are performing distillation attacks... how strange.

▲

twobitshifter 2 hours ago | parent | next [-]

distillation attack? why the violent word choice? When OpenAI crawled Github was that an attack?

▲

MaxPock 3 hours ago | parent | prev | next [-]

Do you have moat if your advanced model can be distilled in a month or two ?

▲

rowanG077 an hour ago | parent | prev | next [-]

Distillation is not an attack. It simply a way to train a model. Not doing it when you are behind is akin to snatching defeat from the jaws of victory.

▲

mensetmanusman 41 minutes ago | parent [-]

It is an attack at a sufficient level of sophisticated analysis. If you destroy the game theoretic first mover advantage, then you destroy the economic incentive to improve things.

	▲	rowanG077 7 minutes ago \| parent [-]
		Given that model distillation has existed since the early days of the current AI boom, and no robust defense has been demonstrated, the available evidence does not support your theory.

▲

PepegaRoach an hour ago | parent | prev [-]

[dead]