On the contrary, because you will want to have those drivers when the time comes to reinstall the system with more modern hardware.

Without X Server support at the OS level for the new hardware, doesn't really matter if vim supports it on its source code.