Yes, and it is mostly trash.
The good part of the Internet today is way bigger than the entire Internet of 1999.
I think size is a smaller problem than link rot. That is and has always been the slow killer of any web directory.