Uninstalled with DDU, switched to multiple versions back. But it wasn't the nvidia driver, and I proved that when I switched to an insider build and the flickers were gone :D

You didn't use a non Nvidia driver then. Sounds exactly like you were always using beta drivers.