You can get DisplayPort KVMs. As a nice bonus the KVM will let you share a single mouse and keyboard set between them.

My monitor (Samsung Odyssey Neo G9) has a usb kvm built in, i can already do that.

Plus I havent really seen an external dp2.1 kvm switch yet and I'm sure if they exist they are expansive.