Remix.run Logo
▲ tantalor a day ago

The first thing I saw when I tried to follow this link is a captcha. So it's no wonder that the agent wasn't able to find this. We are siloing our knowledge unnecessarily.

▲vohk a day ago | parent | next [-]

Lets take a moment to consider why that has started happening.

The lineage of every LLM of relevance today was the largest theft of intellectual property in human history. Every digitised creative work, whether in the public domain or not was taken, often outright pirated, with the explicit intention of being able to trivially produce compelling forgeries. Physical works are being enthusiastically destroyed to digitise them to further feed the hunger. And outside of a few court cases, the original creators across the world have been paid nothing for their work having been stolen and repurposed to put them out of a job.

Meanwhile, those same digitisation efforts have resulted in badly behaved scrapers from all comers absolutely thrashing the entire web, in many cases exponentially increasing the cost of hosting for smaller entities. Larger entities care less about that but are still enthusiastically walling their gardens so they can monetise the output of their communities rather than continuing to allow it to be stolen freely.

We are siloing our knowledge out of desperation. I'm sympathetic to the idea that knowledge should be free but that isn't possible when bad actors like Google and OpenAI are preying on the commons.

▲brookst a day ago | parent | next [-]

From my perspective, the bad actors are the corporations and greedy people who turned copyright into a perpetual rent on IP. If copyright terms and IP laws were reasonable, I'd be 100% with you. But the idea that a novel written in 1940 is still not public domain, just so the heirs (or more likely, corporate purchasers of the rights) can continue to profit on a work that was itself but on the shoulders of thousands of years of civilization? Screw that.

The Walt Disneys of the world screwed themselves on this one. If copyright was still the 20+20 it started as, and if the bulk of people being "stolen" from (don't get me started on using theft to refer to IP), then I think most people would be much more up in arms over the AI industry.

But, in a world with sane copyright laws, perhaps AI companies would have different approaches. Today, if they want anything after 1930, they're either breaking laws or in uncharted territory.

And siloing our knowledge is a silly response even if you are a copyright maximalist.

▲vohk a day ago | parent | next [-]

I have no patience or sympathy for the Elseviers and Disneys of the world, and I agree the endless copyright extensions are terrible, but multiple things can be bad at once. Tearing down a bad system doesn't guarantee a better outcome will result. Even if we accept that those systems need drastic reform, the billions of authors, artists, musicians, programmers, and creators of all stripes still deserve more than just the pride and satisfaction of having made AI companies rich.

I'm also not arguing that siloing is good, only that it's a rational reaction. Creators are uncomfortable having their work used that way and have to protect themselves against scrapers driving up their hosting costs. Other businesses quite reasonably want a share of all the money flowing around. People got tired of the wolves eating their sheep, so they built barns and fences and trained dogs.

If we want to stop the siloing, we need to address the what's causing people to resort to it.

▲brookst 13 hours ago | parent | next [-]

I agree with your conclusion, but it looks like our views of “what’s causing it” are exact opposites. We made it 30,000 years with creators having “just the pride of creation”. I’m deeply skeptical that the IP monetization regime of the past 100 years is the natural state of things.

▲jlg23 2 hours ago | parent | next [-]

> We made it 30,000 years with creators having “just the pride of creation”.

The pride of creation and either someone who funded their work or income generated by their work. I can think of quite a few creators who died impoverished and only became famous after their death but I am not aware of any creator who lived well on "just the pride of creation".

▲bunderbunder 7 hours ago | parent | prev | next [-]

We made it 30,000 years without AI scrapers being able to forcibly extract money from creators’ wallets by using swarms of bots to drive up their hosting costs.

▲rubikscube09 12 hours ago | parent | prev [-]

we made it 30,000 years with the best known creators having guilds, royal patronage, or inheritances.

▲41353aab 9 hours ago | parent | prev [-]

[dead]

▲GolfPopper a day ago | parent | prev | next [-]

Which is all fine and dandy, but the scrapers aren't looting IP for the public good, they're looting it so they can make a profit. It's the class of people and organizations who were already benefitting from broken copyright ignoring the rules themselves, to the detriment of the countless individuals who kept our creativity going.

▲nl 15 hours ago | parent | next [-]

It's ok to be paid while spreading knowledge!

Universities do it, Google search does it, broadcasters do it.

The only place that doesn't really do it is public libraries, which are all subsidized either by governments or donations.

▲voidhorse 14 hours ago | parent [-]

That's all well and good, until the theft and spread of knowledge leaves you permanently unemployed.

Because agents can do labor this is more than just "knowledge sharing". It undercuts human labor power and allows for even grosser concentration of capital.

▲xp84 a day ago | parent | prev | next [-]

The intent of the people who built the railroad across America was to seek profit. So too for most of the important vaccines (shout out to Jonas Salk though, absolute mensch who chose not to). Same for many technologies. That doesn’t change the fact that there were massive benefits to millions of others from having those things exist.

Just because AI companies have profit motives doesn’t mean it isn’t cool as heck that some poor kid with a burner Android phone can use a free ChatGPT account to learn about any topic they want.

▲qotgalaxy 17 hours ago | parent [-]

[dead]

▲engineer_22 a day ago | parent | prev [-]

> they're looting it so they can make a profit

If they're making a profit, it means they're providing a value to customers. In the case of LLM - the value is reducing the friction of accessing knowledge. The knowledge was there all along, but the friction of access too great to generate surplus value.

It is backwards thinking to propose that we are worse off by enabling access to knowledge.

▲sumeno 16 hours ago | parent | next [-]

You can justify any manner of unethical behavior if your bar for ethics is "they're making a profit"

▲hirako2000 20 hours ago | parent | prev | next [-]

If they are making a profit.

But that's right, the side effect is that it reduced friction. The most benefit I get from LLMs when I treat them as search engines.

▲GolfPopper 15 hours ago | parent | prev [-]

>If they're making a profit, it means they're providing a value to customers.

Like Alaric, Temujin, Teach, and Burham!

▲fwlr a day ago | parent | prev | next [-]

You know what will fix all this corporate greed overzealously enforcing intellectual property laws? An equal amount of corporate greed brazenly violating intellectual property laws!

To put it visually:

         selfless humans | corpo greed
                         |
  enforce IP    good ____|____ bad
  violate IP   better    |     bad
ie the valence regarding intellectual property is irrelevant for this kind of motivation.
▲ZenoArrows 7 hours ago | parent | prev | next [-]

And apparently this draconian copyright law was no problem for decades when it protected the business interests of large corporations.

But now that it's individual creators that need protection suddenly copyright law needs to be reformed to serve the interests of large corporations once more. What a scam.

▲throwaway81523 14 hours ago | parent | prev [-]

Besides the copyrights there is also the matter of the techbros DDOS'ing the entire web with unthrottled scrapers. Aaron Swartz was prosecuted for that but nobody shook a finger at the bros.

▲hypendev 8 hours ago | parent | prev | next [-]

> the largest theft of intellectual property in human history. Every digitised creative work, whether in the public domain or not was taken, often outright pirated, with the explicit intention of being able to trivially produce compelling forgeries

Is it theft?

Does knowledge belong to a person, or to the civilization? After all, their knowledge could not have come from nothing, as they too stand on the shoulders of giants - all of us do.

If we took the different route - opening knowledge up instead of focusing on gatekeeping - we'd probably allow people to achieve more.

Multiple times I've hit the gate when it was not necessary. Just yesterday: - Want to read a research paper? Pay up. - Want to access tax funded satellite images? Pay up. - Want to dig through some old parts of the public archives? Pay up. - Want to read an old publication that might contain knowledge, written for the public, which somehow ended up in a collection that requires you to pay up just so you can read 1 paragraph from a 188 paperbck or verify a certain catalogue number exists? Well well, open up your wallet.

In which case are we talking about theft?

Someone's NYT bestselling novel? Those are mostly so cookie cutter it ain't hard to copy them without an AI.

Music? How many times have musicians riffed and ripped off of one another? And now someone can just more easily create a similar song/tune.

Art? You cannot copy a physical art piece. You can reproduce it, but you cannot copy it - it won't have the same value as the original. Even in cases such as Warhol's mass produced art, the original prints have much more value than a random print on a dollar store t-shirt.

And after all, even Google and Open AI are sharing their models for free. You can use Gemini and ChatGPT without paying a dime to any of them. And they are also so kind to share the knowledge on how to build these magic machines AND even give you their machines for free so you can train one of your own.

So I wouldn't call all of this "the largest theft", more like "the largest liberation".

▲xyzsparetimexyz 7 hours ago | parent | next [-]

> Is it theft?

Well we certainly didn't get paid for it, and now our livelihoods are at stake. So yes.

▲hypendev 4 hours ago | parent [-]

Who's?

If you're a writer whose work people enjoy to read, they will still read it.

If you're a painter whose paintings people enjoy to see, they will still look at them.

If you're a musician people enjoy listening to, they will still listen to you.

Nobody's money is being taken here. It's not like people are prompting "Give me xyzsparetimexyz's book cover to cover".

Only think that's taken from someone is the idea that they have the right to own a piece of information.

▲xyzsparetimexyz 2 hours ago | parent [-]

> It's not like people are prompting "Give me xyzsparetimexyz's book cover to cover".

They are literally doing that with slop game clones trying to beat them to market.

▲hypendev 35 minutes ago | parent [-]

Even before AI you had a swarm of slop clone games. Half of steam and itch are "indie" games with are just absurd slop or a game clone.

And still, these games won't be played or take up the same space that the originals have in players minds. I'll enjoy playing GTA 6 - I won't enjoy playing Vibe Car Theft 6 which emulates it. Especially in indie gaming, where people relate to the creator and choose to support them.

▲gewetensleegte 7 hours ago | parent | prev [-]

you're basically saying "it's not theft, because now it's mine"

also,

> Someone's NYT bestselling novel? Those are mostly so cookie cutter it ain't hard to copy them without an AI.

lol then why weren't you a bestselling NYT novelist, had something better to do?

▲Matticus_Rex 4 hours ago | parent | next [-]

> you're basically saying "it's not theft, because now it's mine"

No, that's not at all what they're saying. Taking something is only theft if it's rightfully owned in the first place. He's saying it wasn't rightfully owned.

▲hypendev 4 hours ago | parent | prev [-]

Yes, I find other stuff much more entertaining than writing cookie cutter novels for bored housewives and pseudo-intellectual pop-sci books for dinner conversations.

But also, none of the ideas in these books are novel. Is it intellectual theft to be trained on a book that is based on public research where author just distills the information into an easier to consume format?

▲nl 15 hours ago | parent | prev | next [-]

> The lineage of every LLM of relevance today was the largest theft of intellectual property in human history.

I can't say how strongly and completely I think this framing should be rejected.

What is the point of knowledge if not to learn from.

> Physical works are being enthusiastically destroyed

This makes me sad.

> I'm sympathetic to the idea that knowledge should be free but that isn't possible when bad actors like Google and OpenAI are preying on the commons.

Google and OpenAI are expanding access to the commons like nothing before.

▲dmz73 14 hours ago | parent | next [-]

No, they are locking it behind their corporate walls. Sure, right now they are offering some of it for "free" (give us all your data) or "cheap" (give us all your data and pay some money too) but what happens when all other options are unavailable or difficult to access for most people? Suddenly it is the corporations that decide what is available, for how much, and what is right and what is wrong. They have shown time and again they will bait and switch at will, this is the ultimate run on everything - turn everyone who can think for themselves into zombies and then force them to use technology for everything and charge for it either directly or via endless adds or some mix of the two.

▲voidhorse 14 hours ago | parent | prev [-]

Trying to centralize all information and "intelligence" in one or two providers, charge for "intelligence" "like a utility", and divest citizens of their own skills and recourse to resources is not "expanding access to the commons" lol.

▲hardbass 11 hours ago | parent [-]

What is this telepathic brain modification technology by which people are having their skills divested from them?

▲voidhorse 5 hours ago | parent [-]

There are several papers about "deskilling" and cognitive debt as a result of heavy LLM reliance. Ask your agent to put together a reading list. (If you ask your agent to read the papers for you, there you go, you are an existence proof of the deskilling).

▲hardbass 5 hours ago | parent [-]

Who is forcing you to use the AI other than when job requires it? Nothing is stopping you from manually practicing those skills.

▲busssard 8 hours ago | parent | prev | next [-]

interesting to me is, that the small entities are not protecting their gardens and are freely sharing it usually. and mostly the large corpos are building walls.

▲prefetch a day ago | parent | prev | next [-]

>We are siloing our knowledge out of desperation.

but why does knowledge need to be siloed? elsevier has every right to make a deal with the author of the research and put it behind a paywall or whatever they'd like to do to keep their multi-billion dollar business going, but is this something we should be defending and celebrating as a "solution" to prevent LLMs from making knowledge more available?

and in this instance, why should a researcher that is probably funded by public money, care if openai is disseminating their research?

▲antonvs 4 hours ago | parent | prev | next [-]

> I'm sympathetic to the idea that knowledge should be free but that isn't possible when bad actors like Google and OpenAI are preying on the commons.

This doesn't make sense. If knowledge were (legally) free, then what Google and OpenAI are doing would be fine, no?

Their current transgression is that they're violating laws and conventions about knowledge not being free.

▲unyttigfjelltol 4 hours ago | parent | prev | next [-]

As the tech matures folks will align around RAG with authenticated data sources meaning the models will create demand for licensing of originals that did not previously exist.

▲engineer_22 a day ago | parent | prev | next [-]

Lots of this research work is paid for by the People - via government wealth transfers. The knowledge should rightly be distributed to the People.

If you want to argue that the cultivators of new knowledge should be treated better, I am in agreement, they should receive a greater share of rewards.

The real victims of a shift to open knowledge society would be the publishing cartels, and I can't say I'd feel too bad about it.

▲ahknight a day ago | parent | prev | next [-]

Theft/stolen implies it's been taken and the owner deprived of it. Pirated or copied is more appropriate, but still not quite exact as it's been encoded into what amounts to lossy memory. If I ask a person to tell me about a paywalled article, they'll share what they can remember and likely get some facts wrong. An LLM is the same (these days; GPT-3 was another story).

I do agree that the methods of obtaining much of the material (eg. the published works torrents) were stupidly wrong and they should pay for that. However, legally acquired media being "read" by the training process isn't so different than it being read by a voracious reader: it's lossily encoded in (what amounts to) memories.

The insane scraping levels and behaviors ... not wrong. If only there were companies who already did that responsibly they could contract with for data. Hmm. (But they have to "own" it, as is the SV fashion these days.)

▲kelnos a day ago | parent | next [-]

The AI companies doing their own scraping wouldn't be a problem if they'd to it in a reasonable way. But instead they hammer the same site over and over for data that hasn't been changed, or request the same data in different formats, or through interfaces that aren't efficient.

▲jonathanstrange a day ago | parent | prev | next [-]

It was what's commonly called illegal piracy on a commercial basis and gigantic scale. That normally leads to hefty prison sentences. I've always been against this legal classification and think piracy should be allowed for non-commercial purposes or at least only be considered a very minor crime, but in the present example the piracy was clearly for commercial gains, a company using the illegally obtained material to create essential features of commercial products.

Agreements with publishers after the fact shouldn't even count, particularly since all copyright holders weren't consulted. I wouldn't have given my permission, for example.

It's important to stress that the media were not legally acquired by most US frontier AI companies if not all of them.

▲rexpop a day ago | parent | prev [-]

> Theft/stolen implies it's been taken and the owner deprived of it.

Nope! Theft of the proceeds.

The media may have been legally acquired, but it was done so by violating the intentions and purposes of the content creators.

In other words, people poured their time and attention into something hoping for a return, and got this, instead. And now this is obviating the venues by which creators hoped to receive their social/cultural dividend.

▲Matticus_Rex a day ago | parent [-]

I mean, in a legal sense, no -- it's not theft of the proceeds. You may mean that you think it's morally/philosophically similar to that, in the same sense as piracy and other IP violation, but these things are very specifically not classified as theft from a legal standpoint.

Violating the intentions and purposes of the creators is in some cases an IP violation, and in others it isn't -- it all depends on the details. A lot of AI training on IP-protected materials can fit into the bucket that isn't an IP violation (or any other legal violation), though much of the historical actual training data wasn't collected this way.

IP creators don't have an amorphous right to "a return" or to have their intentions and purposes strictly respected. They have very specific rights in law, and those often don't match up 1:1 with expectations, and almost never with a specific set of the creator's intent (except where that aligns with already-existing law).

▲BobaFloutist 21 hours ago | parent [-]

They aren't making a legal claim, "What they did was technically legal" is almost never a compelling argument in favor of behavior, and the fact that people can't expect legal protections from this behavior is exactly why they're taking matters into their own hands, leading to the information protectionism that started this comment thread.

▲whimsicalism a day ago | parent | prev [-]

Sorry but just because IP has somehow become the current "thing" on the self-described 'left' is not going to convince me that corporate IP & knowledge restriction is actually a good thing and elsevier are the good guys.

> exponentially increasing the cost of hosting

We're on a technical forum, everyone knows the cost of hosting plaintext and what an exponential is.

▲parineum a day ago | parent | next [-]

> the self-described 'left' is not going to convince me that corporate IP & knowledge restriction is actually a good thing

It just goes to show how fluid people's beliefs can be when they have identified a "bad guy". Everything they do is wrong, even when it aligns with their ethos.

▲georgemcbay a day ago | parent | prev | next [-]

> not going to convince me that corporate IP & knowledge restriction is actually a good thing and elsevier are the good guys.

multiple parties can be opposed to each other's goals with all of them still being "bad guys".

▲ a day ago | parent [-]
[deleted]
▲qlte a day ago | parent | prev | next [-]

Weird to turn this into a left/right "thing" based on flimsy assumptions after an election that demonstrated opposition to AI cuts across the political spectrum despite what e/acc types in a bubble on X might believe.

▲whimsicalism a day ago | parent [-]

I'm on the left and I am not an accelerationist. I think the intellectual property theft justification is a bad one for opposing AI and a surprising one to hear from corners of the internet I inhabit. All of my objections would apply equally to an AI trained from permissibly licensed material.

I suspect it is the result of people trying to reconcile disliking something they think isn't capable (or can't admit otherwise) so they have to come up with a capability-independent reason to dislike (climate, IP theft) that doesn’t have to concede that the technology is impressive.

▲voidhorse 14 hours ago | parent | prev | next [-]

Whenever people get their undies in a bundle about this argument I'm amazed at how oblivious of power differentials they are.

There is a difference between a story in which a robin hood liberated knowledge and freely, without any caveats or exchange, delivers it to the masses (think Aaron Swartz) and a story in which a power hungry empire systematically scoops up all the world's resources and decides to permit the masses access so long as they exchange (at a premium) other resources the empire needs to continually solidify its position.

If you don't see how these are different I don't know what to tell you. People making IP theft arguments are more disgruntled about the massive power imbalance between, say, a massive corporation, and a small time creator who can barely even earn a subsistence off their work in the first place, and the former taking from the latter in impunity.

The left rightly sees it as unfair because it is a power imbalance that leads to asymmetrical power of exchange. The companies get the power to continue to extract data from you, all you get is the privilege to then pay them for it.

▲mlcrypto a day ago | parent | prev [-]

The so called progressives have actually been the ones opposed to progress throughout history. If they had their way we would all be frozen in time, entitled to our 1960s education & career

▲nickalaso a day ago | parent | prev | next [-]

AI is already fully capable of solving the majority of/all captchas, you just aren't supposed to do it due to TOS.

I expect with time these kinds of things will change.

▲eddythompson80 19 hours ago | parent [-]

If TOS is the main concern, then surly a “Are you over 18? Yes/No” style page should be enough.

▲rurban a day ago | parent | prev | next [-]

Not we, just Elsevier. As long as Academia sells its research, information will not be free.

▲jazzyjackson a day ago | parent | prev | next [-]

Who says the agent was treated the same as you?

▲nozzlegear a day ago | parent [-]

Who says it wasn't? American AI providers are sticklers for making sure their users don't colors outside of the lines.

▲natebc a day ago | parent | prev | next [-]

If the "AI" scrapers honored HTTP 402 I'd be happy to let 'em in.

▲clickety_clack a day ago | parent | prev [-]

Or necessarily depending on your viewpoint.