I find initial build to be the most annoying, since it stops me from starting new projects in Haskell. It's also very annoying when setting up CI or switching machines or introducing new team members.