That makes no sense. Why would you not be testing with optimized hosting.

If one of the OSs has features that improve performance, why would you not include that in the comparison?