You're always going to be an outsider if you can't speak the language, no matter where you go in the world. B1 is a reasonable level, as it's the bare minimum for doing day-to-day tasks in the local language.

I honestly can't image planning to live in any country for the long term without learning the local language to at least this level.