I think the discussion in recent years has refocused, embracing ethnonatalist implications and challenging the core assertion that "racism is wrong".

My main resistance to that is much the same as yours: the differences are so small, that re-architecting society around them is not going to be enough juice for the squeeze.

But one could also argue that the juice is not even the point: by re-architecting society in this way, you "pre-brutalize" your population so that their threshold for violence against "others" is lowered. Thus your population is closer to being wholly militarized, and theoretically is more effective in war, and is less captured by "weak" or "unmanly" moral ideals, such as empathy.

While this might seem a virtue to someone of an expansionist mindset, in application this principle never, ever works well - again, thanks to those tiny differences. If a citizen is pre-brutalized to have a lowered resistance to killing those with curly hair, how long is it before they kill their next door neighbor with wavy hair, over something like lawn furniture?

Pre-brutalizing your populace to killing any sapiens is enough to brutalize them towards harming anyone else. This is the core of the "imperial boomerang", or the colonial boomerang theory, as to why the great wars of the 20th century took on such a nasty character. The ease with which we dehumanized subject populations was - all too easily - redirected against the neighbors, most memorably with Germany trying to re-create the American West to their East.