Only partly, they also live in extremely remote areas that don't have a lot to offer. It's not like all the other indigenous populations were pacifists, they fought wars, murdered, raided, etc. but they were living in areas that were much more desirable for conquest.