Certainly not gas or oil, which are still cheaper to heat with than heat pumps.

Modern heat pumps are cheaper than oil for heating just about everywhere. They're cheaper than natural gas in most places, unless electricity prices where you live are particularly high.