Thats... exactly what they did. They relied on secrecy and hidden locations to aid their cause.

Like... this is how the entire underground railroad and many other examples worked out.