I don't think I can handle another small model release by qwen, I'm still trying to find the limits of 3.6 27B and they are already threatening us with a new one?

But jokes aside, I love the fast iteration, these are most probably again finetunes on the 3.5 architecture that appear better in internal testing, which is still very nice to see. Putting more and more pressure on the bigger labs to perform better is always a good thing.

▲

genxy 3 hours ago | parent | next [-]

How good must their training pipelines be? Releasing publicly and at this rate has made them very efficient.

▲

sleepyeldrazi 3 hours ago | parent [-]

Finetuning takes little resources, the base model training is the slow and expensive part. Architecturally 3.5 models are identical to their 3.6 counterparts, that is why there is a consensus that those are probably finetunes and not re-trained from scratch, like you will se many people publish their own on huggingface.

▲

genxy 3 hours ago | parent [-]

Understood, but look at their larger cadence over the years and the breadth of models. They are clearly not all finetunes. Meta for all its billions, doesn't have anything comparable.

	▲	bachmeier 15 minutes ago \| parent \| next [-]
		> Meta for all its billions, doesn't have anything comparable. Maybe nothing released to the public. I don't know that all of their models are public. I think all they really care about is that they aren't relying on one or two cloud providers for a critical piece of their infrastructure.
	▲	Computer0 27 minutes ago \| parent \| prev [-]
		competent leadership goes a long way

▲

plutokras 4 hours ago | parent | prev [-]

[dead]