The private AI companies should be forced to release the models as open weights with a license (I.e no commercial use) due the high risk they present and the data they basically steal from everyone to train their models. This should be the safety push not the regulatory capture that Dario is trying.

▲ WarmWash 14 hours ago | parent | next [-]

> the data they basically steal from everyone

What's the precedent?

All I see if a bunch of people who haven't loaded an ad in 20 years and have a 5TB collection of pirated movies and music suddenly decrying that LLM's doing next token prediction over a dataset is theft.

You don't get to change your mind 20 years into "I'm never going to pay for anything binary" ethos (cough look at what this post is cough) that has dominated the internet for decades. If people are genuinely upset about LLMs training on all available data without compensation, all I can say is "Reap what you sow".

▲ theplumber 13 hours ago | parent | next [-]

Ok then can the feds bust the executives of these companies like they did with Kim Dotcom? It’s not like Dario trained his AI in the bedroom or do a small business by letting people scrapping IP work to train their models. He is actively stealing and selling the stolen work and even preaches us safety measures: how to protect us from our own knowledge that he stole!

▲ philipov 13 hours ago | parent | prev | next [-]

It would be all fine and good if they kept it non-commercial, but when you start charging money for it that's when you're stepping out of bounds. If they want to benefit from fair use, they should contribute their results back to the public domain. Getting it for free and then commercializing it is what's unethical.

	▲	WarmWash 11 hours ago \| parent [-]
		>Getting it for free and then commercializing it is what's unethical. Like all those unethical software devs taking salaries for turning stackoverflow into products? I suppose the blood still flows since now they just use LLM output? Any way you try and slice LLM morality, you end up with "It's bad because they are not me" reasons. "When I monetize information I get for free, it's good, when they monetize information they get for free, it's bad"

▲ koe123 12 hours ago | parent | prev | next [-]

I am not convinced by your retort, which essentially boils down to “some people pirate, so its ironic some people, maybe different, are mad at dario!”

▲ Diogenesian 8 hours ago | parent | prev [-]

  "Reap what you sow"

It is kind of incredible that you're not focused at all on the copyright holders, instead focusing on random tech people you had online disagreements with.

Artists and writers got screwed first by piracy, then by generative AI. They didn't sow anything. They just got reaped.

And the only thing the copyright hypocrites are "reaping" is a feeling of hypocrisy. Congrats for pointing that out. Your comment is simply myopic.

▲ raxxorraxor 14 hours ago | parent | prev | next [-]

> the data they basically steal from everyone

Agreed. Especially since now competitors have more difficulties getting the same advantage. They don't have to do so immediately and perhaps not their specific tuning. But the weights of the raw training data at least should be publicised.

▲ jefftk 13 hours ago | parent | prev | next [-]

> release the models as open weights with a license (I.e no commercial use) due the high risk they present

For some kinds of risk (ex: walking people through on how to make infectious bioweapons) an open-weights approach would increase risk.

▲ johndhi 16 hours ago | parent | prev | next [-]

Good idea! I'd never heard that. Very interesting.

But wouldn't this help china build models just as good as ours immediately? Wouldn't it make the investment in training a model worth a lot less?

▲ tempfile 15 hours ago | parent | prev | next [-]

> no commercial use

Why? It's not like they did the hard work. It's disgraceful that this kind of commons enclosure has been allowed in the first place.

	▲	rexpop 14 hours ago \| parent [-]
		Wow, thank you for this! I'd forgotten about enclosure for some years. > The law locks up the man or woman / Who steals the goose from off the common / But leaves the greater villain loose / Who steals the common from the goose.

▲ pembrook 15 hours ago | parent | prev | next [-]

In an earlier phase of AI I might have agreed but now the publicly available data they’ve trained on is increasingly useless for the frontier.

RL/post-training is now a much bigger part of it, with that being largely proprietary and expensive work that the open source model just won’t fund.

	▲	8 hours ago \| parent [-]
		[deleted]

▲ amelius 13 hours ago | parent | prev [-]

I'd rather they published the training data.

Then we can verify that there's nothing nasty hiding in it.