Remix.run Logo
thread_id 9 hours ago

I don't see any mention of Project Ocean - AKA Google books. Before AI they endevoured to digitize books in a massive online library. This inccluded rare and out of print books many which are archived at libraries. Because they had to preserve the books and return them in the condition they received then they created elaborate technology to accomplish this. The project was met with significant legal challenges from authors and publishers which was eventually overcome. The legal precedents that were established from Project Ocean laid the ground work for the process as it exists today. Books from libraries are still being preserved.

https://en.wikipedia.org/wiki/Google_Books

https://arstechnica.com/tech-policy/2015/10/appeals-court-ru...

https://arstechnica.com/ai/2025/06/anthropic-destroyed-milli...

probably_wrong 9 hours ago | parent | next [-]

Whenever I need something from Google Books I inevitably reach the message that this is a limited preview and the part I need is not included.

I therefore feel the same way about Google Books that how I felt when I learned that What.cd went down: that I don't gain or lose anything anyway because I never had access to begin with, and that by not making it 100% publicly accessible you're asking for the data to one day disappear forever.

ndiddy 8 hours ago | parent | next [-]

At one point Google Books was supposed to act as a clearinghouse for scans of out-of-print books. You could have purchased a scan of any book on the site for a reasonable price, and libraries could subscribe to a service where the full text of all books was available. This settlement then got shot down because some research libraries and authors argued that this was anti-competitive, and instead wanted Congress to pass a law to free up the rights to orphaned books so anyone could start a competing service. No progress on this was subsequently made because nobody in Congress cares enough about the rights to out-of-print books to get legislation passed. The whole reason why they're out of print when ebooks and print-on-demand exist is that they won't get enough sales to make it worth the time and money to figure out who the royalties should go to. It's not a flashy issue that would make a ton of people vote for you to get re-elected, and it won't create a ton of new jobs. The result is that now nobody outside of Google gets to see the full Google Books scans.

allturtles 7 hours ago | parent | next [-]

Yes, this was a great tragedy. I was very sad to see academics at the time arguing against Google providing what would have been one of the greatest storehouses of readily available knowledge in the world, in favor of an imaginary alternative that didn't exist and never would.

cube00 6 hours ago | parent [-]

> Google providing what would have been one of the greatest storehouses of readily available knowledge in the world

I'd be worried about how much they'd be charging for access once they had the monopoly on so many rare books.

allturtles 4 hours ago | parent | next [-]

This is exactly the kind of pointless concern I'm talking about. How many legal digitial providers of those rare books are there now? Zero, I believe.

It's the logic of cutting off one's nose to spite one's face, which prefers that no one benefit rather than Google see any benefit.

anon84873628 6 hours ago | parent | prev [-]

Then at least there would be outrage to drive the passing of the needed legislation which otherwise hasn't come to pass anyway.

avidiax 6 hours ago | parent [-]

Copyright law desperately needs a production requirement or allowance.

The copyright owner must make new copies of the work available; the price must be no greater than the original price (not inflation adjusted). And if they fail to do so, anyone may produce copies and escrow the original price (less the cost of production) for collection by the copyright holder.

That means that orphan works are effectively in the public domain. Calculus professors can ask students to get the cheaper 2nd edition, not the latest 22nd edition. And a company like Google could make scanned works available in their entirety for a small amount of money for each work. And the copyright holder still gets their end, without having to arrange a printing or hold stock.

shagie 5 hours ago | parent [-]

As a photographer, do I have to make every photograph that I've ever sold available to anyone to buy forever more? Can I refuse to sell a print to someone? I wasn't famous when I sold one for $20 back in the 90s... if I became famous, would I still need to sell that at $20 (inflation adjusted)?

What happens to limited editions of print runs? Can I not make a run of 200 prints anymore because the 201st will be something that someone could request?

Does a musician have to license any song they made to anyone who asks? Can they refuse to license a song to some organization they disagree with and not have it fall into the orphan works category?

---

Amending copyright to the way you describe requires a renegotiation of the TRIPS agreement ( https://en.wikipedia.org/wiki/TRIPS_Agreement ) with all the nations of the WTO (or withdrawing from the WTO).

avidiax 4 hours ago | parent [-]

Under my proposal, if someone wants to make prints of one of your old photographs, you are getting ~$20, which is ~$20 more than you are getting now. So it doesn't seem like a damage to you. If you get famous and now you could sell a print for $2,000... how is this helping society since the work has already been produced, so no new incentive is necessary?

I suppose the rule could make reference to a rival good, i.e. the 22nd and 23rd editions of the calculus textbook. It should not be reasonable for the publisher to make the 22nd edition only available for $1,000, and the 23rd edition for $250. But that definition would invite many lawsuits and chilling litigation in general. A clear definition based on the historic price is much simpler.

You can still number your limited runs, and your limited runs still have increased numismatic value over some other reproduction.

I don't envision licensing of performance rights in this system, just recordings or reproductions.

Is this a reduction of the rights granted by copyright? Yes, intentionally so. It is stripping copyright holders of the right not to copy, against the interests of society in granting that copyright in the first place.

bigbadfeline 4 hours ago | parent | prev [-]

> It's not a flashy issue

It's a very serious issue, very well known to the people with the connections and power to affect it.

> [ it wouldn't ] make a ton of people vote for you to get re-elected

The tons of people are moved by the media, people are oblivious to the tricks of that trade, for the same reasons, obviously. In other words, this issue isn't something that happens to slip below the radar, it's kept stealthy by well organized engineering and considerable expense.

> and it won't create a ton of new jobs

Nothing ever creates tons of new jobs, the "tons" are reserved for promises and other useless noise.

p0w3n3d 8 hours ago | parent | prev | next [-]

Quod licet Iovi, non licet bovi

Big companies will read up the books and make their AI recite them from memory, but Archive.org was sued for renting one book on an exclusive basis (unless one would return, another wouldn't be able to rent)

misnome 8 hours ago | parent [-]

> Archive.org was sued for renting one book on an exclusive basis (unless one would return, another wouldn't be able to rent)

No, this is what they were doing before, but they explicitly started lending out "unlimited" copies, which is why they got sued.

ndiddy 8 hours ago | parent | next [-]

That's why they got sued, but the suit is mainly over whether controlled digital lending is legal at all rather than their "emergency library". Archive.org lost the case on summary judgment, meaning that they could not come up with a single fair use argument for CDL that the judge found compelling enough to let the case go to trial. The full judgment is here https://storage.courtlistener.com/recap/gov.uscourts.nysd.53... but here's a couple excerpts:

> The crux of IA's first factor argument is that an organization has the right under fair use to make whatever copies of its print books are necessary to facilitate digital lending of that book, so long as only one patron at a time can borrow the book for each copy that has been bought and paid for. See Oral Arg. Tr. 31:10-15. But there is no such right, which risks eviscerating the rights of authors and publishers to profit from the creation and dissemination of derivatives of their protected works. See 17 U.S.C. §§ 106(1), (2). IA's wholesale copying and unauthorized lending of digital copies of the Publishers' print books does not transform the use of the books, and IA profits from exploiting the copyrighted material without paying the customary price. The first fair use factor strongly favors the Publishers.

> In this case, there is a "thriving ebook licensing market for libraries" in which the Publishers earn a fee whenever a library obtains one of their licensed ebooks from an aggregator like OverDrive. Pls.' 56.1 ¶¶ 577-578. This market generates at least tens of millions of dollars a year for the Publishers. Id. ¶¶ 170, 172. And IA supplants the Publishers' place in this market. IA offers users complete ebook editions of the Works in Suit without IA's having paid the Publishers a fee to license those ebooks, and it gives libraries an alternative to buying ebook licenses from the Publishers. Indeed, IA pitches the Open Libraries project to libraries in part as a way to help libraries avoid paying for licenses. See Pls.' 56.1 ¶ 383 (presentation IA gave to libraries asserting that pairing with IA means that "You Don't Have to Buy It Again!"); id. ¶ 382 (different presentation promising that the Open Libraries project "ensures that a library will not have to buy the same content over and over, simply because of a change in format"). IA thus "brings to the marketplace a competing substitute" for library ebook editions of the Works in Suit, "usurp[ing] a market that properly belongs to the copyright-holder."

SideQuark 6 hours ago | parent [-]

> suit is mainly over whether controlled digital lending is legal at all

No, it was not, even supported by the quotes you pulled. Libraries right now, with publisher blessing, offer all manner of controlled digital lending. The suit was because IA did it buy undercutting the publishers copy rights to that legal market. Had IA simply done what every other library has done to provide controlled digital lending, there would be no suit.

ndiddy 4 hours ago | parent [-]

"Controlled digital lending" is not a generic term for "lending digital items". It specifically refers to the practice of a library digitizing physical materials in its collection, then lending them digitally based on a 1:1 owned-to-loaned ratio. The idea is that the library should be able to treat digitized versions of a book the same way it treats the physical book, and the total number of physical and digital copies of the book that are lent out at once should never be more than the number of physical copies that the library has.

In contrast to this, the e-book lending practiced by most libraries with publisher blessing involves the library purchasing special library-specific e-book licenses from the publisher. These licenses contain various contractual restrictions, such as the library having to re-purchase the e-book after a certain amount of time or after a certain number of borrows.

allturtles 8 hours ago | parent | prev [-]

There is so much misinformation/confusion about this... they go sued after lending "unlimited" copies, but they were sued (and lost) for lending exclusive copies (controlled digital lending):

> “At bottom, [the Internet Archive’s] fair use defense rests on the notion that lawfully acquiring a copyrighted print book entitles the recipient to make an unauthorized copy and distribute it in place of the print book, so long as it does not simultaneously lend the print book,” Judge John G. Koeltl of the U.S. District Court in Manhattan wrote. “But no case or legal principle supports that notion. Every authority points the other direction.” [0]

[0]: https://www.insidehighered.com/news/tech-innovation/teaching...

palmotea 6 hours ago | parent | prev [-]

> Whenever I need something from Google Books I inevitably reach the message that this is a limited preview and the part I need is not included.

> I therefore feel the same way about Google Books that how I felt when I learned that What.cd went down: that I don't gain or lose anything anyway because I never had access to begin with, and that by not making it 100% publicly accessible you're asking for the data to one day disappear forever.

Can you still search the restricted parts? If so there's still value to it: it helps you identify the book so you do an inter-library loan to get at the full content. Sure, it's not frictionless, but I wouldn't be all or nothing about it.

jacekm 8 hours ago | parent | prev | next [-]

> The project was met with significant legal challenges from authors and publishers which was eventually overcome

I don't think they were overcome. As far as I remember Google couldn't make the books available so they abandoned the project. They possess the scans (if they didn't delete them) but they won't be made public.

chungusamongus 7 hours ago | parent | next [-]

IIRC the courts ruled that because it would be implausibe for a person to use google books previews to read an entire work (you'd have to make a whole bunch of separate accounts to do so), it could not plausibly impact the market for that work.

doctorpangloss 6 hours ago | parent | prev [-]

The consensus among copyright lawyers is Google lost Authors Guild v Google, but for some reason the media and Wikipedia do not clearly report it that way.

titzer 9 hours ago | parent | prev | next [-]

Like all things, Google will eventually realize they cannot make significant ad revenue and they will eventually give up and discontinue serving this, though I doubt it's more than a scratch in terms of disk space.

It's great they did this, but the Google that is today cannot be trusted with data of public value anymore.

greyw 9 hours ago | parent | next [-]

It's data for their AI pipeline. Basically digital gold.

dblohm7 7 hours ago | parent | prev | next [-]

> It's great they did this, but the Google that is today cannot be trusted with data of public value anymore.

They never should have been trusted in the first place.

ktm5j 7 hours ago | parent | prev | next [-]

I think you're missing the point. Maybe I'm wrong, but I'm pretty sure they're trying to point out that this book scanning doesn't need to be destructive. I'm not sure if AI companies are using a scanning method that damages the book or not, but they destroy the books after scanning to avoid copyright issues (ie they aren't duplicating the books). This Google project seems to demonstrate that this isn't actually necessary, and that the AI companies are just doing it out of laziness.

shagie 6 hours ago | parent | next [-]

If it isn't scanned destructively, is it a liability?

Can you do anything else with the book? What are its costs for storage in a way that retains the value of the book? If the assets of the warehouse are sold to another company (see also https://paizo.com/blog/paizo-restructuring-a-difficult-updat... ), what are your obligations for the format shifted copy that you retain?

These questions imply that there's a liability that exists when retaining the original that has little value to the company. And they (the books) aren't assets that can be resold.

It's easier (and cheaper), has no ongoing costs for physical storage, and answers those questions without creating legal entanglements for the future company.

ktm5j 5 hours ago | parent [-]

Questions don't imply anything, you're just asking things. I don't have the answers to your questions, but the point is that Google was able to scan books without destroying them while still avoiding legal consequences (with some effort).

shagie 4 hours ago | parent | next [-]

The physical books that were scanned by Google were returned to the libraries.

https://btaa.org/library/programs-and-services/book-search/f...

> Will scanning harm the books?

> No. Google developed innovative technology to scan the content without harming the books. Any book deemed too fragile will not be scanned by Google, but may be treated by expert library staff. Once scanned, all print volumes are returned to the library collections.

That was an inherently different goal (borrow the books from the library, scan them, and return them) than the Bartz v. Antrophic ruling.

https://cases.justia.com/federal/district-courts/california/...

> Storage and searchability are not creative properties of the copyrighted work itself but physical properties of the frame around the work or informational properties about the work. See Texaco, 802 F. Supp. at 14 (physical), aff’d, 60 F.3d at 919; Google, 804 F.3d at 225 (informational); Sony Corp. of Am. v. Universal City Studios, Inc. (“Sony Betamax”), 464 U.S. 417, 447 (1984) (rightful interests). In Texaco, the court reasoned that if a purchased scientific journal article had been copied “onto microfilm to conserve space, this might [have been] a persuasive transformative use.” 802 F. Supp. at 14 (Judge Pierre Leval), aff’d, 60 F.3d at 919 (reducing “bulk[ ]” “might suffice to tilt the first fair use factor in favor of Texaco if these purposes were dominant“). In Google Books, the court reasoned that a print-to-digital change to expose information about the work was transformative. Google, 804 F.3d at 225 (Judge Pierre Leval). And, in Sony Betamax, the Supreme Court held that making a recording of a television show in order to instead watch it at a later time was copying but did not usurp any rightful interest of the copyright owner. 464 U.S. at 447, 455. Important to the Supreme Court’s reasoning was the expectation that most such copiers would not distribute the permanent copies of the work. Finally, in A&M Records, Inc. v. Napster, Inc., our court of appeals recognized the reasoning just explained, and therefore rejected by contrast a digitization effort that was touted as space-shifting but in fact resulted in the multiplication of copies shared with outsiders through a file-sharing service. 239 F.3d 1004, 1019 (9th Cir. 2001), aff’g in this part 114 F. Supp. 2d 896, 912–13, 915–16 (N.D. Cal. 2000) (Judge Marilyn Hall Patel) (citing Sony Betamax and Texaco).

> Here, every purchased print copy was copied in order to save storage space and to enable searchability as a digital copy. The print original was destroyed. One replaced the other. And, there is no evidence that the new, digital copy was shown, shared, or sold outside the company. This use was even more clearly transformative than those in Texaco, Google, and Sony Betamax (where the number of copies went up by at least one), and, of course, more transformative than those uses rejected in Napster (where the number went up by “millions” of copies shared for free with others).

---

The AI training isn't borrowing from libraries and returning from libraries. Instead, it is buying a book, format shifting, and retaining that format shifted version from its own use. The company can't do anything else with the book once they've format shifted it. They can't donate it and they can't resell it. In that light, destructively scanning the book is the best option. There is no value in trying to non-destructively scan it because otherwise all it would do is sit in a warehouse and cost money to pay for storage of something they can't sell.

ktm5j 3 hours ago | parent [-]

> The AI training isn't borrowing from libraries and returning from libraries

Perhaps that's an important distinction here, I was really just trying to explain what I thought the commenter was trying to say. Calm down with the copy pasta walls.

But I still think that AI companies could make a very similar argument to the one Google made in your copy-pasta. The laziness I refereed to earlier is the fact that they haven't even tried. They could donate the books afterwards which would go a long way towards helping that argument in court.

shagie an hour ago | parent [-]

My copying and pasting is twofold.

First, in today's environment people will state AI hallucinations as fact or "google it yourself" as the reference. If someone doesn't know where to find that information they're left with the "someone on the net said XYZ".

Secondly, I'm not always certain that if I do provide a link to a large document that people will find the relevant section in there. And second and a halfly, if someone comes back to it in a year or two or five that the link will still be live. I've had situations in the past where I've provided a link and then the domain changes hands and the new owners of the site put up a retroactive robots.txt and make it inaccessible on the wayback machine.

---

The question for an AI company that can't return, sell, or donate the material after it has been scanned - are they then to pay to store it in a warehouse indefinitely?

After they've format shifted the content and retained the format shifted content for continued use in training, it becomes at least a very gray area to donate the original.

And even if the books were scanned like Google Books did, and they could donate them to libraries - the libraries don't want those books. These aren't rare books in that people would expect you to wear cotton gloves while handling them... they're books that have mostly disappeared from availability.

https://old.reddit.com/r/books/comments/1vugion/the_federal_... provides an example of what is being seen in a used book store:

> I work for a large used bookstore with an online component. We're getting slammed with orders for books like the proceedings of an obscure 1992 Dutch geology conference or $500 festschrifts about D-module applications we would have previously sold to some university library. We've never once had an order for anything anybody would actually want, and most of this shit has sat on our shelves for years, if not decades.

Neutron Radiography: Proceedings of the First World Conference San Diego, California, U.S.A. December 7–10, 1981 is technically a rare book. https://www.amazon.com/Neutron-Radiography-Proceedings-Confe...

If you had a copy of it, I would challenge you to find a library that would accept it as a donation.

In the event that you wanted to read a copy of it, there is a copy of it in the Library of Congress. https://search.catalog.loc.gov/instances/b220c9bd-63ad-5a8b-...

ktm5j 35 minutes ago | parent [-]

So you're a lawyer and a librarian now? If a library really won't take the books for whatever reason you're imagining, I'm sure there are other organizations that would.

jujube3 2 hours ago | parent | prev [-]

The answer to his question is "yes." If the book isn't destroyed, it becomes a liability to Anthropic, because then it's no longer format-shifting.

zardo 4 hours ago | parent | prev [-]

If you're going to destroy the book anyway you'll go with the easier method for a good scan(separate the pages from the spine)

nazgulsenpai 9 hours ago | parent | prev [-]

They are also an AI company now. Why would they stop?

JKCalhoun 9 hours ago | parent | next [-]

Also, why would they ever share their collection?

Book scans, secreted away, are worthless to the public.

al_borland 9 hours ago | parent | prev [-]

They could use them as training data, without providing access the actual books.

jimmaswell 7 hours ago | parent [-]

At least we would all benefit from the books this way, so long as legal nonsense keeps the scans unavailable to the public.

al_borland 5 hours ago | parent [-]

I don’t think locking the content of rare books away in the hands of corporations who only give us access to tools trained on the books, and not the actual book, is a good path forward.

This doesn’t incentivize them to be good stewards of this data and making anything in the public domain available. It incentivizes less access to the source material, having to blindly trust their tools, and is effectively automating plagiarism.

janpeuker 6 hours ago | parent | prev | next [-]

The irony of countries blocking Anna's Archive (UK, Italy, Netherlands etc) but then it's the hackers who conserve and steward the books. Because governments can't stop AI companies from shredding history like they did with Google Books _because_ they actually tried to do it _by the book_.

spandrew 6 hours ago | parent | prev | next [-]

Amazon also did this for their "Look Inside" feature. To do this they had to spin up massive digital infrastructure——then realized that they could sell that infrastructure and make more money than from the books they were scanning.

This is was what ended up spinning up AWS as a business.

I dislike the idea of destroying rare books--but how rare? A digital copy has a lot more benefit.

wrathofquan 7 hours ago | parent | prev | next [-]

I've worked in academic libraries since 2010. I've always felt like it was a mistake for our digital library leadership to put so much trust in Google Books despite their promises to maintain the integrity of libraries (this mostly happened by the way).

At the time it was obvious and innovative but over time it was clear Google was establishing a technical precedent to corrode what libraries have the power to do. I'm hoping we can continue to do the good work but it's exhausting.

toomuchtodo 8 hours ago | parent | prev | next [-]

Internet Archive version: https://openlibrary.org/

Info on where to send books not yet in their collection: https://help.archive.org/help/how-do-i-make-a-physical-donat...

Mobile apps to determine if they need a book: https://help.archive.org/help/donate-books-app-for-ios-and-a...

Web app: https://archive.org/want/?mode=donation_book

For example, I donated a copy of Systems Bible (out of print, hard to find imho) and paid for it to jump the digitization queue (https://archive.org/details/systemsbiblebegi0000gall/). The original book will remain stored as a physical backup. It's not fully publicly available of course due to copyright (it will eventually be made public by the Internet Archive once its copyright expires ~2084 and it enters the public domain), which is where shadow libraries|archives like Anna's Archive and Z-Library fill the gap.

If you have rare books you would like digitized, archived, and distributed, I am very interested in providing assistance.

shagie 7 hours ago | parent [-]

As an aside... https://www.google.com/books/edition/The_Systems_Bible/mrOsb... (and I haven't hit any "you can't read this" limits yet).

While the hard copy is a bit pricy for my shelf of curious books, it's also available on kindle. https://www.amazon.com/SYSTEMANTICS-SYSTEMS-BIBLE-John-Gall-...

7 hours ago | parent [-]
[deleted]
b112 6 hours ago | parent | prev | next [-]

If you read the judgement against (I think) openai, the judge said that it was OK to scan the books for LLMs, if they were destroyed afterwards. That is, only one copy of the data existed.

economistbob 3 hours ago | parent | prev [-]

[dead]