Not at all.

I've run Void Linux + Xmonad for many years without any such issues. I also recently installed CachyOS for my kid to game on (KDE Plasma) and it works super well.