No, not generally.

That said, there can be some "Oh yeah - well if you're insinuating that white people are displacing black people then YOU are the racist" which is just... not the same thing. One view of the world may incorporate a significant accommodation and acknowledgement of historical discrimination, enslavement, red-lining, you name it. The other is... technically correct I suppose, but complete horseshit on the merits until we start to see significant, systemic harm going the other direction as a result of race.

But that's just, like, my opinion man.