Hydrogen will leak out of about anything, and then there's hydrogen embrittlement.

Salt caverns seem good. And a bit of leakage is likely OK (the pass through storage via hydrolysis is far from 100% efficient anyway) and the only piping might be from hydrolysers and to turbines very close by, so should be manageable...