A semi related: a patch for those with multiple cards. You can unlock around 20% increased card to card speed on consumer GPUs using this library:

https://github.com/aikitoria/open-gpu-kernel-modules

The hardware supports it, but then Nvidia disabled it if the driver detects cheaper cards. This bypasses the NVidia slowdown.

Indeed, I already posted it earlier but this definitely deserves a top level comment.