IANALE, but any time the exercise of fundamental rights is being constrained, I understand intermediate scrutiny is the floor.

Yes but foreigners have way lower presumption of rights.