New capitals also help prevent revolutions and uprisings. It's a lot easier to have a government that's insulated from the unrest of the masses, when everyone in its capital is loyal to it.