I'm considering buying enough batteries for my day usage, then recharging off the grid during off-peak hours. I can add solar later on.

The panels are the cheapest components. If you're incurring all the costs to retrofit your electrical panel with an inverter + batteries, you may as well implement on-site generation from the start to recoup more of the costs.