That's the thing though: a competitor with better power efficiency can undercut you and take your customers

Or they could charge the same as you and make more money per customer. If they already have as many customers as they can handle doing that may be better than buying hardware to support a larger number of customers.