You may be thinking of a different context. This is about road trips, not around town fill-ups. On a road trip, people stop to fill the car, get snacks, take a leak, stretch, etc, which is why the average tends to be 15 minutes or so.

You can do faster stops for the weekly fill-up, certainly. But in that case the comparable situation in the EV is zero minutes. The vast majority of owners will spend far fewer minutes on refueling for their EV in a given year even if the road trip stops really did take two or three times as long.