Remix.run Logo
▲ functionmouse 5 hours ago

wasn't LLaMa only open source because it had already leaked anyways? And they wanted to spin it in a positive light for their stakeholders.

▲A_D_E_P_T 4 hours ago | parent [-]

It opened the floodgates, though. It was a real paradigm shift. After LLaMa, everybody saw that you could release large open models without any negative repercussions, and DeepSeek et al. hopped aboard the wagon. LLaMa was the first popular model that was truly open to the global public.

Meta earned a ton of goodwill by doing this -- it was very brave, and very influential. In my eyes, it outweighs everything negative they've ever done.

▲alerighi 4 hours ago | parent | next [-]

Let's stop saying that open weight models are open source. They are just a software that you can run on your own hardware (if you have a ton of money to spend to get it anyway) but they are not open, they are as open as any proprietary software that you can run on your PC is.

You can't study them, you can't modify them, you can't improve them, you can't look into how they are built etc.

▲A_D_E_P_T 3 hours ago | parent [-]

I never said they were open source. Everything else you wrote is factually incorrect.

When you run a proprietary program (like Adobe Photoshop or a closed-source game) on your PC, you get a compiled binary of machine code. The high-level logic is stripped out, variables are obfuscated, and the EULA legally forbids you from decompiling, reverse-engineering, or modifying the binary.

With an open model, you get the actual Python/C++/CUDA code defining the exact mathematical structure of the model. And you get a weights file, which is an unencrypted, open array of floating-point numbers representing every synaptic strength in the network.

So you can inspect the exact mathematical state of the model at any arbitrary moment during inference -- in other words, you can study open models. You can fine-tune or quantize them -- in other words, you can improve them quite significantly! And much much more.

▲ 4 hours ago | parent | prev | next [-]
[deleted]
▲latexr 4 hours ago | parent | prev | next [-]

> it was very brave, and very influential. In my eyes, it outweighs everything negative they've ever done.

Are you being sarcastic? Please let it be that you’re being sarcastic.

▲A_D_E_P_T 3 hours ago | parent [-]

I am serious. I believe that the LLM is the defining technology of our time -- at least as important and as impactful as the internet itself -- and that Meta's opening of LLaMa has profoundly changed the landscape for the better.

▲lirolero 4 hours ago | parent | prev [-]

[dead]