There are some companies making heat batteries that you can install inside your house. They won't last very long but it's a great way to store excess energy from your rooftop solar and use it for heating and warm water. Also it allows you to timeshift when you draw power from the grid (i.e. when it's cheap rather than when you need hot water).

Larger scale batteries can store enough energy for seasonal storage. The larger the size, the better the insulation can keep the heat losses to a minimum. Basically you have a smaller surface area relative to the volume and mass. But even with a small unit, you can keep it hot for quite long.

Stuff like this is easier in areas that are already on some sort of district heating or have some kind of water based central heating. For those systems it's pretty much plug and play. You don't really need to modify the houses.

I think Helsinki has a few larger scale units already operational and a few more under planning / construction. I think the largest one will store 90ghw of heat. Which is quite a lot.

The beauty with thermal storage is that almost any kind of mass with enough heat capacity works. Water, rocks, sand, etc. All fine.