Nope, LLMs are quite functional in non-english languages. My partner regularly works with ChatGPT in Turkish

My experience: hosted LLMs are very good, but even 30B models you run locally are quite poor (at least in Romanian). To some degree they still hallucinate words (they don't conjugate properly sometimes).