Yep, this can absolutely be done. Home wall chargers are just a fancy switch[1], you just need a way to enable/disable it. Could be a feature of the charger, but in the worst case you could add your own secondary contactor that removes power from the entire charger when you don't want the car to be charging.

[1]: They also have control pins to tell the car the maximum amperage they're allowed to draw, but that's not relevant to the feature of "disable the charger when I don't want it charging"