I think the "Exactly equivalent to Americans panicking about Spanish" comparison is good. Thanks!

I was going to add "coming into a pub in Wales and complaining about the occupants switching to Welsh", but that is a slightly different scenario. Partly because Welsh is much rarer.