>But if your goal is fitness then the e-bike is not the way to go.

If the e-bike is an alternative to a road bike then yes. I'd argue that is almost never the case. The people I've spoken to are using them as an alternative to driving which is clearly beneficial to their fitness.