The phone batteries weren't a high load kind of affair. They merely needed to change the varying resistance of the carbon microphone into an audio voltage - on the order of milliwatts of power - to send down the line. A more modern phone, still using a carbon microphone but powered by the line, needed about 20mA of loop current to do this. The telephone terms for the old system vs. the newer is "local" vs. "common" battery.

Heavy duty batteries - specifically the "A" batteries that powered the vacuum tube heaters in early radios - were made rechargeable to save cost.

This might be a bit of a tangent but I couldn't help but wonder if the appearance of 20ma here is related to the old fashioned, but I understand commonly used, 4-20ma current loop signalling in industrial applications.