The speed of charging is irrelevant, because the energy consumption is the same. The power requirements for a charging station is determined by the number of cars charged in a day, not by how fast they are charged.

The fast chargers that achieve charging in a few minutes, and which are indeed able to provide up to 1 MW of charging power, have their own internal batteries, so they take from the electrical grid a power averaged over a long time, not the peak power that they provide to the charged vehicle.