The total size isn't what matters in this case but rather the total number of files/directories that need to be traversed (and their file sizes summed).

I responded here, it's essentially the same content: https://news.ycombinator.com/item?id=46150030