Probably the location they were last registered to vote? If they've never been registered to vote, then the place they were last domiciled?

If we're on the democratic reforms train, then this is all a silly discussion we're forced to have because the US doesn't have proportional representation.