That would be true if busses didn't have to accelerate, decelerate, open doors, kneel and go through the many parts of stopping that aren't strictly people getting on or off.

The counterpoint is any bus route that has an express option that runs in parallel. Every time I have taken the express route, the bus can be full to the gills, but is always faster than the non-express bus.