Isn't it fascinating that despite `while true; do claude --yolo` over a weekend being all it takes to port some project across platforms, LLMs completely fall apart when it comes to speaking grammatical and natural Japanese?

Free tier Gemini CLI literally writes Android app for me by just endlessly wondering in English. AGI's here. And it struggles with Japanese. How!?

▲

Etheryte an hour ago | parent | next [-]

To be fair, in my experience LLM-s struggle to some extent with nearly every language that isn't English. Compared to many others, English is a very simple language and it has the largest body of material to learn from to boot. The more nuanced a language, the more LLM-s spout garbage.

▲

jameson 3 hours ago | parent | prev [-]

> struggles with Japanese

It doesn't mention mistranslating, so it's difficult to know the root of the problem is AI "struggling".

> It doesn't follow our translation guidelines. > It doesn't respect current localization for Japanese users, so they were lost.

I believe this is the root of the problem. There are define processes and guidelines, and LLM isn't following it. Whether these guidelines were prompted or not is unclear but regardless it should've been verified by the community leaders before it's GA'ed

▲

numpad0 3 hours ago | parent [-]

That's not the root of the problem. The root of the problem is that LLMs just can't constitute a punctually Japanese understanding of text like that guideline and speak in Japanese with native fluency no matter what. I just know this from knowing both sides of English-Japanese language pair. And I find that somewhat fascinating in a sense.

	▲	ChadNauseam 2 hours ago \| parent [-]
		Wow. That's crazy. I would be very interested in a blog post on this subject if you ever wrote one. I wonder how this affects the perception of LLMs in Japan