We do slow down.

I've lost count of the times I've been riding at walking pace behind someone, on a shared path, waiting to get past because they're completely oblivious to the bell ringing, politely asking, or even flashing lights.