From the blog post moonshot refers to it as open source but only mentions releasing the weights.

So far all the Kimi models have open sourced their code, their weights, and published technical reports explaining their training methodology. I expect the Kimi K3 Technical Report will come out July 27 and they usually publish the code and the weights alongside that.

▲

charcircuit 2 hours ago | parent | prev [-]

The weights are the "source" of a model.

▲

tadfisher 2 hours ago | parent | next [-]

If weights are the source for models then ELF binaries are the source for software.

▲

RobMurray an hour ago | parent [-]

clearly not true. the weights are the preferred form for making modifications. Do you really think people should be downloading hundreds of TB of training data and running make to build the model on their own cluster of GPUs?

	▲	villish an hour ago \| parent \| next [-]
		Random people? No. Governments and big corporations? Yes. It removes any concern of "backdoors", and is currently the best starting point for your own model which will be as capable as k3.
	▲	an hour ago \| parent \| prev [-]
		[deleted]

▲

villish an hour ago | parent | prev | next [-]

I want to caution against this line of thinking. NSA's fast16 program silently altered data during nuclear simulations, and that is also possible within open weight models. There is no reason to think there is anything like that currently, it also cannot be dismissed. Open source would include the training data so you could create a similarly capable model.

▲

charcircuit an hour ago | parent [-]

Training runs are not deterministic. Not just in the case of floating point not being associative, but nodes have hardware issues and go down and back up at various points through training. Problems get encountered and then various parameters get changed during the middle of a training run.

Making the process of creating the source code repeatable goes beyond the idea of open source. Open source is about being able to work with the code, not recreate it. It doesn't require domain experts to document every single thing they know. For example look at some of the GPU drivers in the Linux kernel. The GPU is not properly documented and there is trust that vendors are implementing things correctly.

	▲	villish 39 minutes ago \| parent [-]
		> Training runs are not deterministic. I agree which is why I said you could make a similarly capable model. > Open source is about being able to work with the code, not recreate it. You can also use a hex editor to modify compiled binaries, but no one would consider that "open source".

▲

dymk 2 hours ago | parent | prev [-]

The weights are the output artifact, the training corpus and system are the source.

	▲	culi an hour ago \| parent \| next [-]
		Kimi publishes their code and a technical report on their methodology. But I think the weights are still important. It means anyone with the resources could run the same model on their own hardware.
	▲	charcircuit an hour ago \| parent \| prev [-]
		The training corpus + training code is just an automated editor for the weights. It would be like requiring the source code for Visual Studio for software made within it to be open source. Weights are not an output artifact no more than source code is. There is never a moment where you can claim that it's done. As requirements change new ways to change the weights / code come up. With different projects you might want to import the weights / code into a bigger model / codebase.