Never had this issue with several cellphones I had in ye olden times when all cellphones had removable batteries. All it takes is a properly designed connector.

Yeah, none of my Nokias with a removable back cover and battery had that issue. What you realistically might've had was instead that you dropped your phone on the floor and the battery came flying out.