> human-level to run on a single 16GB GPU before the end of the decade.

That's apparently about 6k books' worth of data.

For the weights and temporary state, yes. It doesn't sound like a lot until you remember that your DNA is about 600 books worth of data by the same metric.