I wonder what "ordinarily resident" means legally. Like has a permanent address there, even if they don't live there physically..?

Yes. If you are, for example, even a US citizen, permanently living in Crimea, you are still subject to limitations, imposed by sanctions.