You can actually do a lot with a non-congested build server.
But I would never say no to a faster CPU!