Wasn’t he Swedish?

Yes. All the prizes except the peace prize are awarded in Sweden. Norway was in a union with Sweden at the time the prizes were set up, but it's not definitely known why he chose the Norwegian parliament (via the Norwegian Nobel Committee) to aware the peace prize.