| ▲ | Project Gutenberg – keeps getting better(gutenberg.org) |
| 463 points by JSeiko 4 hours ago | 130 comments |
| |
|
| ▲ | cosmos0072 2 minutes ago | parent | next [-] |
| From Italy, https://www.gutenberg.org/ gives a 404 error and https://gutenberg.org/ opens a very official-looking page stating "police notice. This site is under judicial seizure" and references a sentence number: "criminal proceedings 52127/20 R.N.R.I. tribunal of Rome" Any idea what's happening?
I thought PG published public domain books... |
|
| ▲ | JSeiko 4 hours ago | parent | prev | next [-] |
| Hi! I'm one of the programmers at Gutenberg.
We've been improving the site a lot over the past few months (and more is coming!).
If you haven't visited the page recently, it's worth checking out again: https://www.gutenberg.org/ |
| |
| ▲ | svat 7 minutes ago | parent | next [-] | | Have you considered having a detailed version history for each book (etext)? The process of submitting fixes to typos etc in books involves sending an email (https://www.gutenberg.org/help/errata.html) and although the last time I did this (2011) the fixes did get applied reasonably quickly (couple of days), it all felt a bit opaque. The version history could also include the project (usually PGDP correct?) the etext originated from; that way one would be able to compare against the actual page scans. I have very mixed feelings about Standard Ebooks and would much prefer being able to use Project Gutenberg directly, but one good thing Standard Ebooks does is that every book has an associated git repository (on GitHub), so it's (in principle) possible to see a history of fixes to the text over time. | |
| ▲ | lucb1e 21 minutes ago | parent | prev | next [-] | | Huh that's interesting: 4.5 seconds for the TCP handshake and an additional 9.2 seconds for the TLS handshake. Is this some kind of captcha, since most bots would disconnect before that, so if you complete it once then it knows you're good? (Until the bots catch on of course, but so long as it works it's relatively unintrusive and not discriminatory against uncommon client software (that is, non-Chrome/ium).) The rest of the requests were lightning fast | | |
| ▲ | codys 11 minutes ago | parent [-] | | I think their site is just slow, potentially because more people than they are used to are trying to view it. I was unable to load it initially (got an error from firefox) and had to re-attempt. Still slow if one forces a reload (shift-r, etc, to not use local cache). |
| |
| ▲ | jefurii 2 hours ago | parent | prev | next [-] | | When I thought about Project Gutenberg I remembered that original brutalist non-design. The current site has been very tastefully updated but looks like it's still very accessible if you turn styles off. Great job! | | | |
| ▲ | Falimonda 4 hours ago | parent | prev | next [-] | | The book list elements on front page render as both horizontally and vertically scrollable divs on mobile - seems like an opportunity for improvement. Keep up the good work! | | |
| ▲ | JSeiko 4 hours ago | parent [-] | | good feedback thanks! Doing an iteration on the homepage design is actually pretty high on the priority list. will keep your feedback in mind! |
| |
| ▲ | zamadatix an hour ago | parent | prev | next [-] | | Thanks for the free work! Project Gutenberg is nice to have :). On the site I noticed the library boxes have roughly a single extra line causing a scrollbar to appear and the last line to be chopped off https://i.imgur.com/PQ8T0qc.png is there an issues/bug portal to properly submit these kinds of things? | |
| ▲ | xrd 4 hours ago | parent | prev | next [-] | | Thank you for your work. This site is an international treasure. | |
| ▲ | excitednumber 3 hours ago | parent | prev | next [-] | | Thank you for being one of the best places on the internet | |
| ▲ | ExtremisAndy 3 hours ago | parent | prev | next [-] | | Oh, my! This does look nice. Thank you for your hard work! | | |
| ▲ | JSeiko 3 hours ago | parent [-] | | Thanks! We're currently working on a design update of the page of any specific book. Should be online soon (next 1-2 weeks or so) |
| |
| ▲ | smallnix 3 hours ago | parent | prev | next [-] | | There's a minor bug with chrome in android where the menu will not close when you tap outside the menu or on the menu link/button | | |
| ▲ | JSeiko 3 hours ago | parent | next [-] | | I've messaged the guy who's best suited to fixing this. He'll be on it this weekend | |
| ▲ | JSeiko 3 hours ago | parent | prev [-] | | will open an "Issue" for it |
| |
| ▲ | freedomben 2 hours ago | parent | prev | next [-] | | I can't say for project Gutenberg specifically, but in general a huge issue I see is OCR errors. What do you all do to address OCR? | | |
| ▲ | gluejar an hour ago | parent | next [-] | | Check out Distributed Proofreaders: https://pgdp.net | |
| ▲ | lapetitejort 2 hours ago | parent | prev [-] | | I uploaded a PDF to archive.org that auto-OCRs with plenty of mistakes. I have found no way of updating the entire stack of documents produced. I wonder if Project Gutenberg is similar |
| |
| ▲ | shuvrojit 3 hours ago | parent | prev | next [-] | | Great Work. Thank you. I'm also a programmer. If you are ever short on help, let me know. I would love to contribute. | | | |
| ▲ | samcollins 4 hours ago | parent | prev | next [-] | | Very cool! Do you have a recommended way for an agent to see an index of the books and epub links? (I can’t quite tell if that’s an egregious abuse of the site or you’re perfectly fine to share without human eye balls hitting your www?) | | | |
| ▲ | TimorousBestie 2 hours ago | parent | prev | next [-] | | Wanna let you know you’re doing great work and you have my dream job, thanks to the team for everything! | | |
| ▲ | JSeiko 2 hours ago | parent [-] | | it's not my day job. PG is open-source. I'm "just" a contributor | | |
| |
| ▲ | BiraIgnacio 3 hours ago | parent | prev [-] | | Thanks so much for the work you and your team do! |
|
|
| ▲ | throw0101c 4 hours ago | parent | prev | next [-] |
| While PG has probably gotten a lot of use and growth with the growth/maintreaming of the Internet since the 1990s, (TIL) it started back in 1971: > Michael S. Hart began Project Gutenberg in 1971 with the digitization of the United States Declaration of Independence.[5] Hart, a student at the University of Illinois, obtained access to a Xerox Sigma V mainframe computer in the university's Materials Research Lab. […] This computer was one of the 15 nodes on ARPANET, the computer network that would become the Internet. Hart believed one day the general public would be able to access computers and decided to make works of literature available in electronic form for free. […] * https://en.wikipedia.org/wiki/Project_Gutenberg |
| |
|
| ▲ | thangalin an hour ago | parent | prev | next [-] |
| Project Gutenberg is a treasure trove, though many technical details defy automatic typesetting of its books. Standard Ebooks takes consistency to an unbelievable level. My post compares various sources of public domain books with an eye on typesetting: https://dave.autonoma.ca/blog/2020/04/11/project-gutenberg-p... |
|
| ▲ | Someone1234 4 hours ago | parent | prev | next [-] |
| I'm surprised no eBook Reader vendor has a Project Gutenberg "Store." Where you can just browse Gutenberg, find a book, and just grab it down to the reader. Instead, they either are actively hostile (Kindle), or require the use of Calibre (which itself is good, it is just the friction). |
| |
| ▲ | horsawlarway 3 hours ago | parent | next [-] | | I've used https://standardebooks.org/ to pull nicely formatted Project Gutenberg books on any e-reader that supports a browser (in my case, Boox). Technically, I can also just directly pull the epub from Project Gutenberg, but sometimes the formatting leaves a lot to be desired. Once you get an e-reader that runs a semi-capable OS (ex - stock android, even an older version), it's hard to go back to something like a kindle. | | | |
| ▲ | WillAdams 3 hours ago | parent | prev | next [-] | | Used to be one could sort of get that with the Project Librivox: https://librivox.org/ e-book app Gutebooks (in addition to their audio app), but it seems to have been deprecated (I'm no longer able to connect to the server on my copy (which I only got 'cause there was an in-app purchase to fund Project Librivox). FWIW, Barnes & Noble has been plundering the public domain using a book composition/keying house in the Philippines to make their public domain books which they make available in their stores --- Amazon apparently has a similar setup for the Kindle Store: https://www.amazon.com/Public-Domain-Books-Kindle-Store/s?k=... Rather a shame that PG didn't monetize by putting their books up there pre-emptively. | | |
| ▲ | dessimus an hour ago | parent | next [-] | | >Barnes & Noble has been plundering the public domain using a book composition/keying house in the Philippines to make their public domain books which they make available in their stores Why is it 'plundering' for B&N to print physical books, transport them to their brick-and-mortar stores to sell? There are real costs associated to doing so. It would not have zero cost for me to print and bind a copy myself at home. | |
| ▲ | JSeiko 2 hours ago | parent | prev [-] | | the way I see it PG is a labor of love. Bit odd if Barnes & Noble or whoever piggyback off it. But in the end - the more people read the books, the better. | | |
| ▲ | WillAdams 2 hours ago | parent [-] | | It is a public good, and it would be appropos if corporations would support it directly rather than work at cross-purposes to it. If Amazon is going to sell public domain texts, then it would make sense to source them from PG, and fund some money from those sales to the non-profit, similarly, they could then funnel reports of typos to PG for review and correction (it was a bit of a struggle the last time I tried to get a text corrected, and the project founder/director actually stepped in on my behalf). | | |
| ▲ | JSeiko 2 hours ago | parent [-] | | that would be great! Sadly I'm not very confident that that will actually happen ... | | |
| ▲ | WillAdams an hour ago | parent [-] | | Needs new legislation where the commons/public domain have public benefit corporations appointed as the manager of said resource. |
|
|
|
| |
| ▲ | GaryBluto 3 hours ago | parent | prev | next [-] | | Most of them offer their own paid storefronts and have a perverse incentive not to offer a large area full of free books. | | |
| ▲ | JSeiko 3 hours ago | parent [-] | | probably true. Maybe an true open-source eReader should exist. | | |
| |
| ▲ | JSeiko 3 hours ago | parent | prev | next [-] | | I've heard that the newest Kobo e-readers have a browser that you could use to go to gutenberg.org and directly download files. but yes, generally I agree with your point. Library of 75k books seems pretty valuable to have direct access to. | |
| ▲ | daveoc64 3 hours ago | parent | prev | next [-] | | You can download books directly from the Project Gutenberg website using the web browser on most eBook readers - even the Kindle supports it. | |
| ▲ | cstever 3 hours ago | parent | prev [-] | | No money for them. |
|
|
| ▲ | gluejar 3 hours ago | parent | prev | next [-] |
| Nice to see so much appreciation for what we do. (I'm the new-ish executive director.) Any wikipedians reading this, the article about PG is... aging. Last I looked, it said we offered Plucker files. @Jseiko has done some nice work. |
|
| ▲ | fmajid 2 hours ago | parent | prev | next [-] |
| Worth mentioning the Project Gutenberg ZIMs. You can download the entire ENglish Gutenberg corpus for about 60GB (English Wikipedia ZIM complete with images is ~120GB): https://ebookfoundation.org/openzim.html |
|
| ▲ | JKCalhoun 3 hours ago | parent | prev | next [-] |
| Project Gutenberg had (has?) a tendency toward plaintext that always put me off. (And it has been over a decade I'm sure since I explored the site—so I am no doubt now misinformed.) I like a styled formatted book—would prefer PDFs. (I know, not a popular format apparently.) I like the idea of Project Gutenberg but guess I found book scans on archive.org my preference. My go-to example is Lewis Carroll's "Through the Looking Glass" with the fantastic art of John Tenniel and Carroll's sometimes creative formatting of the prose… I see they (Project Gutenberg) have ePub now, which can be good if well done. (If not well done it can be a kind of mess. Re-flowable "HTML", paginated… Anyone ever try to print a long web page and did you enjoy the result? Perhaps that is as much on the ePub reader though.) |
| |
| ▲ | JSeiko 3 hours ago | parent | next [-] | | We're supporting EPUB3 for the vast majority of books! At the same time we also have a "Plain Text" version for each as in a sense it's the most robust. PdFs are in the works! | | |
| ▲ | JKCalhoun 2 minutes ago | parent [-] | | That's cool. I'll have to read up on EPUB3—I'm not familiar with it. (I worked on iBooks for the Mac like 15 years ago—it's where I got to dive into the ePub format. A lot has changed in the standard since I am sure.) |
| |
| ▲ | JLO64 3 hours ago | parent | prev | next [-] | | As others here have mentioned, https://standardebooks.org/ is excellent and my understanding is that they use Gutenberg books as a source for theirs but done up much nicer. | | | |
| ▲ | RattlesnakeJake 3 hours ago | parent | prev | next [-] | | Check out Standard eBooks. They take the text from Gutenberg and add a level of polish to the ePubs. | |
| ▲ | jiffygist 3 hours ago | parent | prev | next [-] | | I on the other hand prefer epubs for fiction. I mostly read on the phone. | |
| ▲ | skrtskrt 3 hours ago | parent | prev | next [-] | | The common issue with PDFs is that e-readers generally have terrible support for them. | |
| ▲ | gluejar 3 hours ago | parent | prev | next [-] | | PDF coming this year. | |
| ▲ | graemep 3 hours ago | parent | prev | next [-] | | I have got quite a few books over the years from Gutenberg, and the epubs have been fine 0 even of illustrated ones. | |
| ▲ | the_af 3 hours ago | parent | prev [-] | | I like plain text. You can always post process it into any other format you prefer. | | |
| ▲ | JSeiko 2 hours ago | parent [-] | | it's also very "accessible" - good for assistive technologies and people with "ou-of-the-ordinary" requirements |
|
|
|
| ▲ | ssgodderidge 2 hours ago | parent | prev | next [-] |
| Looks like the top downloaded book yesterday[0] was Concrete Construction: Methods and Costs by Gillette and Hill.[1] Beat out Moby Dick, Count of Monte Cristo, Frankenstien, Romeo and Juliet, and others. > 23644 downloads in the last 30 days. I wonder if this is bot behavior? 23k downloads feels like a lot? [0] https://www.gutenberg.org/browse/scores/top
[1] https://www.gutenberg.org/ebooks/24855 |
| |
| ▲ | sovietswag 2 hours ago | parent | next [-] | | Haha well there is an exciting movie about concrete coming out, “The History of Concrete” by John Wilson. Surely the superfans are studying up | |
| ▲ | JSeiko 2 hours ago | parent | prev [-] | | bot traffic would be my guess too. I doubt there was a sudden global spike in interest in "Concrete Construction Methods" :D |
|
|
| ▲ | kreyenborgi 3 hours ago | parent | prev | next [-] |
| Gutenberg is awesome. There is also https://www.fadedpage.com/ from Canada I think https://runeberg.org/ from Sweden |
|
| ▲ | cold_tom an hour ago | parent | prev | next [-] |
| Project Gutenberg feels like the opposite of modern internet design philosophy.
Quiet, useful, accessible, and built to last. |
|
| ▲ | Myzel394 33 minutes ago | parent | prev | next [-] |
| I wonder if the people behind project Gutenberg use Anna's Archive or mam for books that can't be put on Gutenberg. |
|
| ▲ | ndr42 3 hours ago | parent | prev | next [-] |
| The project was geo-blocked in Germany for a long time: https://news.ycombinator.com/item?id=29024039 |
| |
|
| ▲ | RattlesnakeJake 3 hours ago | parent | prev | next [-] |
| As a Kindle user, I still miss the old version of the site. The new one looks great on normal desktop, but the old one was simple enough to load and directly download books on the device's built-in browser. |
| |
| ▲ | JSeiko 3 hours ago | parent | next [-] | | That's interesting. What about the new design prevents you from doing it? Genuinely asking here. We may fix it if it's actionable | | |
| ▲ | RattlesnakeJake 3 hours ago | parent [-] | | And now it's time to put my foot in my mouth. I haven't used it in a while because it was frustrating, but you guys seem to have already fixed it :) The previous version of the site had two major flaws: 1. The search bar had been removed from the top of the page, and hidden behind a "Click here to search" (or similar) link partway down the page 2. Once you opened that page, the coloring of the site was so washed out on e-ink that the text input was hard to find. Thanks for fixing it! | | |
| ▲ | JSeiko 3 hours ago | parent [-] | | "you guys seem to have already fixed it" - that's what we like to hear :) |
|
| |
| ▲ | graemep 3 hours ago | parent | prev [-] | | Is that a Kindle issue? You can download books in most browsers. I know Amazon have done things to make life difficult for other stores in the past. | | |
| ▲ | RattlesnakeJake 22 minutes ago | parent [-] | | I'd call it one of those middle-ground things: • On the one hand, E Ink devices have a fairly known set of limitations, and it would be ridiculous for me to expect them to render the whole web well. • On the other hand, it's good for website designs to consider the kind of devices employed by their users. Using a Kindle to access Gutenberg is likely less of an edge case than it would be for other sites, so it's worth the extra design work. (Keep in mind that -- given my sibling comment -- this is all theoretical. The latest iteration of Gutenberg's site is much better than the previous version) |
|
|
|
| ▲ | smilespray 2 hours ago | parent | prev | next [-] |
| I remember printing out project Gutenberg books in the mid-90s, four regular pages to an A4 page, double-sided on my inkjet. I had a background in typography, so I made it work. Any yes, the text needed a lot of processing to make it right. Now, in my early fifties and with declining eyesight, that's out of reach now. Thanks for sticking with the project! |
| |
| ▲ | JSeiko 2 hours ago | parent [-] | | that's cool! one of my "pet-ideas" is actually to make an AI-agent that does all that typographical work for any PG book to make it nicely printable without any manual labor whatsoever. Maybe that's doable now ... | | |
| ▲ | smilespray 2 hours ago | parent [-] | | That is doable. Most of my work was regexp and repetitive stuff. And the typograhpy stuff is achievable with the current state of the art models. Not that I remember what I did, it was 30 years ago. | | |
|
|
|
| ▲ | seizethecheese 4 hours ago | parent | prev | next [-] |
| A big pet peeve of mine with Project Gutenberg was the lack of mobile styling. Looks like it’s been fixed! Awesome. |
| |
|
| ▲ | elias1233 40 minutes ago | parent | prev | next [-] |
| I thought this was for the Wordpress Gutenberg Editor for a second |
|
| ▲ | mowmiatlas 4 hours ago | parent | prev | next [-] |
| Made an app that allows reading PG books as audiobooks on iPhone https://loudreader.io/ |
| |
|
| ▲ | aronhegedus 3 hours ago | parent | prev | next [-] |
| Recently downloaded Moby Dick from here:) very easy to use |
| |
|
| ▲ | oidar 3 hours ago | parent | prev | next [-] |
| I'm slightly curious how PG handles heavily illustrated books. I've downloaded some years ago, and the quality of the illustrations was always pretty poor. Has it been improved lately? What's the QA like for illustrations? |
| |
| ▲ | gluejar 2 hours ago | parent [-] | | Nowadays we depend on scans from Internet Archive, Hathitrust, and other sources. Some scans are better than others. Bear in mind that our illustrations need to be in the public domain and usually from the same edition as the text. https://www.gutenberg.org/help/errata.html |
|
|
| ▲ | autoexec 2 hours ago | parent | prev | next [-] |
| I love how usable the site is even with JS disabled! |
|
| ▲ | bryankaplan 3 hours ago | parent | prev | next [-] |
| I find it interesting that the context of this comments page apparently overrides the normal definition of “PG” on HN. |
| |
|
| ▲ | AndrewStephens 3 hours ago | parent | prev | next [-] |
| PG remains one of the best things on the internet. The amount of fascinating material almost beggers belief. |
| |
| ▲ | JSeiko 3 hours ago | parent [-] | | the amount of weird/interesting stuff that one would find nowhere else is possibly the coolest aspect of PG imo |
|
|
| ▲ | jwpapi 2 hours ago | parent | prev | next [-] |
| Please give me some book recommendations :) |
| |
|
| ▲ | carlosjobim 3 hours ago | parent | prev | next [-] |
| Their feeds of new books is a goldmine: https://www.gutenberg.org/ebooks/feeds.html Every day you'll get much more than you're bargaining for, right into your feed or inbox. Easy download books you're interested in and put them on your Kindle. |
| |
|
| ▲ | monegator 2 hours ago | parent | prev | next [-] |
| I keep getting PR_CONNECT_RESET_ERROR |
| |
| ▲ | JSeiko an hour ago | parent | next [-] | | just heard back that the server provider has been doing a security update. Maybe you were one of the users that got unlucky as a result... maybe try later if still interested | |
| ▲ | JSeiko 2 hours ago | parent | prev [-] | | I've reported it. |
|
|
| ▲ | kgwxd 2 hours ago | parent | prev | next [-] |
| How did "Concrete Construction: Methods and Costs" come to be the #1 download? |
| |
| ▲ | JSeiko 2 hours ago | parent [-] | | good question. first though - maybe some bot has downloaded it often for whatever reasons and our systems didn't detect it as bot traffic. just a guess. |
|
|
| ▲ | taubek 4 hours ago | parent | prev | next [-] |
| Thank you for reminding me about this project. Didn’t visit it in a long time. |
|
| ▲ | Timixx an hour ago | parent | prev | next [-] |
| 1 |
|
| ▲ | solarity_studio 4 hours ago | parent | prev | next [-] |
| Awesome |
|
| ▲ | brcmthrowaway 3 hours ago | parent | prev [-] |
| I can't read anymore due to fear of not being productive with AI |
| |
| ▲ | JSeiko 3 hours ago | parent [-] | | maybe there's a way to read more productively using AI: https://x.com/karpathy/status/1990577951671509438 could be a trick to ease that fear :D | | |
| ▲ | zozbot234 2 hours ago | parent [-] | | I've found that the larger open-weight AI models do a great job of explaining the old non-fiction content on PG, particularly magazine articles which are a good size for the AI to handle. It breaks down the long wall-of-text paragraphs for you and explains all the historically relevant background that would've been assumed to be known back in the day. If you ask it to assess the relevance of the text in the present day it will also do that very nicely, highlighting the places where the text shows old-fashioned viewpoints that would be sharply criticized today. | | |
| ▲ | JSeiko 2 hours ago | parent [-] | | so maybe Karpathy has a point that LLM-assisted reading should be a thing. Would be cool if that worked on E-Reader screens as well. Maybe when the browsers on E-Readers become good enough ... |
|
|
|