> If I use black skin tones as my default emoji set even though I'm white... I imagine others will find that weird at least.

Then don’t? Why create some weird hypothetical? Just let people be who they are.