The good part of the Internet today is way bigger than the entire Internet of 1999.

I think size is a smaller problem than link rot. That is and has always been the slow killer of any web directory.