... and once you get to the destination you have to build your whole industrial infrastructure from a tiny seed.

It's bad enough to do on Mars (or an asteroid or other solar system environment) where you can get spare parts sent over in a few years and ask ground control for answers to problems, have them simulate things on Earth or in cislunar space and put a lot of engineers on it. The more I think about it the worse it seems in our solar system -- but interstellar travelers are truly on their own.