| ▲ | jdlshore 12 hours ago |
| To be clear, the issue is not that the books were used to train Claude, but that they were pirated. |
|
| ▲ | sillysaurusx 6 hours ago | parent | next [-] |
| It's an unfortunate outcome. Now to be a big player in AI, you have to have enough capital to buy your own library worth of books and digitize them. (Fun fact: a pallet of books is called a "gaylord," and they buy hundreds of gaylords.) I created books3 to help settle the question of whether AI companies should be allowed to train on books. The outcome of "it's okay to pirate books as long as you're only training on them" was a long shot, but it would've let individual hackers train their own AI models (assuming access to sufficient compute, which you can get e.g. via https://sites.research.google/trc/about/). Now we're in a world where you have to have dozens of millions in capital to do substantial work. I heard at one point Eleuther was gathering public domain training data. I wonder if they ever built a corpus large enough so that training on books doesn't really matter... |
| |
| ▲ | kryogen1c 4 hours ago | parent | next [-] | | > Fun fact: a pallet of books is called a "gaylord," A Gaylord is a type of box that fits on a pallet. There are multiple ways to palletize products, like shrink wrapping or metal banding | |
| ▲ | spaqin 4 hours ago | parent | prev [-] | | Ladder-pulling at its best. It's also easier to swallow the fine once you've launched a successful product after pirating the books. | | |
| ▲ | usef- 3 minutes ago | parent [-] | | Judging by the current comment section, most HN people seem to want the ladder pulled (an observation, not agreement) |
|
|
|
| ▲ | mountainriver 4 hours ago | parent | prev | next [-] |
| This is why you should always distill your models from a competitor. Let them take on the liability |
|
| ▲ | jamesjhare 4 hours ago | parent | prev | next [-] |
| how much of your economic output are you comfortable with companies like Anthropic stealing to put you out of work? at least in Player Piano they paid the workers who made the cassette tapes that made the robots work. our current LLM overlords demand that they be able to basically steal the sum total of all human knowledge so that they can sell it back to us at a rate they set. they should have been shunned by society and made penniless when they first announced their goals but we have a bunch of deeply misanthropic people who have money and want to make a world where computer slaves do their bidding. |
| |
| ▲ | blackqueeriroh 4 hours ago | parent [-] | | All of it. | | |
| ▲ | ori_b 3 hours ago | parent [-] | | If you believe information deserves to be free, and if most of your earnings were from information that wasn't given away for free -- well, if you want people to give up their ill gotten gains, maybe you can start by setting an example. So, mind sending me your bank account information? I'll promise to make good use of it. | | |
| ▲ | JAlexoid an hour ago | parent [-] | | You seem to think that AI companies sell you content, which is false. You get a service. The service is using their compute power to run a model and their scientists to build the model. |
|
|
|
|
| ▲ | EmoteSupportBot 11 hours ago | parent | prev [-] |
| A critical distinction, because they were going to to find terabytes of not pirated books to train on that contained the sum history of humanities knowledge /s |
| |
| ▲ | Aurornis 11 hours ago | parent | next [-] | | They actually did this. > Anthropic spent many millions of dollars to purchase millions of print books, often in used condition. Then, its service providers stripped the books from their bindings, cut their pages to size, and scanned the books into digital form — discarding the paper originals. Each print book resulted in a PDF copy containing images of the scanned pages with machine-readable text (including front and back cover scans for softcover books | | |
| ▲ | nextaccountic 6 hours ago | parent | next [-] | | > Then, its service providers stripped the books from their bindings, cut their pages to size, and scanned the books into digital form — discarding the paper originals. This is worse than pirating books to an absurd degree, it's almost a parody - the company that slurps all human knowledge ends up not only metaphorically, but also physically destroying those books, like an information vampire. Authors don't even receive any financial compensation if the books were bought second hand, either. There's no benefit in doing that. (Not that making one final sale of a hardcover copy would make any difference though) If Anthropic were at least buying ebooks, this insanity wouldn't need to happen. Unfortunately there is no bulk rates for buying millions of ebooks like you have in the used book market | | |
| ▲ | JAlexoid an hour ago | parent | next [-] | | It reads like you're in favor of banning resale and lending(aka libraries) of books... because the authors aren't compensated. There's such a thing as fair use and digitizing privately owned printed material is absolutely legal... including for corporations. | |
| ▲ | blackqueeriroh 4 hours ago | parent | prev | next [-] | | No, it’s proof purchase of how stupid the publishing industry is. Maybe publishing houses should just pay authors good money, like a goddamn salary, and get a book out of them every few years. | | |
| ▲ | bandrami an hour ago | parent [-] | | They can't for the same reason that cab companies can't make their drivers employees: they would have to employ far, far fewer of them than they do on contingency. |
| |
| ▲ | antisthenes 3 hours ago | parent | prev [-] | | The AI craze not only destroyed books, but many small websites who couldn't bear the load of constant scraping, or many communities that took open forums and took them offline or put them behind closed doors. There is less publicly available knowledge now on the Internet than there has been 3 years ago. |
| |
| ▲ | modeless 7 hours ago | parent | prev | next [-] | | Great, so now instead of allowing anyone to train on already scanned books for free, we can have only the richest big labs buy all the books and scan them privately to train their proprietary models. And since they buy the books used, authors still don't get any money. But at least the books are destroyed afterwards! What an improvement! | | |
| ▲ | fluoridation 6 hours ago | parent | next [-] | | >instead of allowing anyone to train on already scanned books for free That would be pirating. So your complaint is that they didn't do more piracy? | | |
| ▲ | modeless 5 hours ago | parent [-] | | My complaint is that after this settlement nothing has materially changed except that the big labs now benefit from higher barriers to entry in their market. Authors don't make more money (other than a one time protection payment from Anthropic to publishers and some lawyers). Literally no one else benefits, except I guess used book marketplaces and book scanner vendors. To be clear, this isn't a problem with the court process. Everything here appears perfectly in accordance with the law. It's just an absurd state to be in. |
| |
| ▲ | jamesjhare 4 hours ago | parent | prev [-] | | no we should destroy the works of these ghouls and support humans instead of this destructive and useless technology the people operating frontier labs are bad people they cannot be trusted in any way the best solution to them would be to send them to monster island (even though it's really a peninsula) |
| |
| ▲ | jamesjhare 4 hours ago | parent | prev | next [-] | | well if they made a PDF copy to process they violated copyright | |
| ▲ | BikiniPrince 5 hours ago | parent | prev [-] | | How is this ruled as piracy then? I am confused. | | |
| |
| ▲ | qq66 11 hours ago | parent | prev | next [-] | | They bought, scannned, trained from, and destroyed millions of paper books, which was ruled legal. This lawsuit was for training from LibGen. | | |
| ▲ | scotty79 10 hours ago | parent [-] | | This is such a petty and impotent ruling. If you want to ban them from using culture to make derivative works without proper compensation then do that. But if you don't want to ban them, telling them to buy one book of each, likely second hand, is complete pettiness that resulted in destructive scanning of millions of books, many of which were already practically available in digital form. | | |
| ▲ | gruez 7 hours ago | parent [-] | | >This is such a petty and impotent ruling. If you want to ban them from using culture to make derivative works without proper compensation then do that. That's because the judges are supposed to rule on questions of law (ie. "is AI training fair use?"), not whether they think AI's good or not. |
|
| |
| ▲ | amanaplanacanal 11 hours ago | parent | prev [-] | | They could have purchased the books instead. It was easier to pirate. |
|
