That's where the idea of intersectionality comes in. A person who is white and poor might be worse off than someone who is black and rich; however, someone who is black and poor would likely be worse off than both of them.

That's also why DEI advocates generally don't advocate focusing exclusively on race. Instead they generally advocate that DEI focus on many factors such as race, wealth, disability, sexuality, gender, military service, etc.

I think that's a step in the right direction. I'd just take it one step further, consider all the factors of each person's life, and thus treat people as individuals and not as representatives of a few select groups. Intersectionality excludes too many factors as it focuses on just a few.