There is however also the long tail of open source software that isn't packaged for your favorite distribution.

That is very true. But because it is open source, one can request for packaging, contribute a package, use a third-party repository, or build it from source when needed.