Has been a major issue for me with Xfce and Gnome over the years, mostly just switched window managers.

Xfce is just ridiculous, it has 1px thin area to grab, and last time I checked they just mentioned you should use alt right click instead.