I spend full 20x the week quota in less than 10 hours. How is that possible? Well try to mass translate texts in 30 languages and you will hit limits extremely quick.

▲

pxc 6 hours ago | parent | next [-]

Translation generally works well with very small models compared to the frontier LLMs. You can definitely run a model on your own hardware for this.

▲

holoduke 5 hours ago | parent [-]

Maybe words. But quality texts in even with opus not perfect. But good enough.

▲

pxc 5 hours ago | parent [-]

For short texts, the translation I usually want the most is fast translation, and local models are actually great for this.

But for high-ish quality translations of substantive texts, you typically want a harness that's pretty different from Claude Code. You want a glossary of technical terms or special names, a structured summary of the wider context, a concise style guide, and you have to chop the text into chunks to ensure nothing is missed. Even with super long context models, if you ask them to translate much at once they just translate an initial portion of it and crap out.

Are you using it for localization or short strings of text in an app? I wonder what you can do to get better results out of smaller models. I'm confident there's a way.

	▲	holoduke an hour ago \| parent [-]
		Yea. I agree. In our case we are creating short news articles of max 3 or 4 paragraphs. The texts are translated in multiple passes into various languages. We use a simple system prompt that instructs the llm to ensure simple authentic language output. With Opus we get seriously good results. The goal is not literal translation, but good translations. I tried hoiku for a while, but its not good in many languages. Sonnet is okaish, but not good enough.

▲

Perz1val 5 hours ago | parent | prev | next [-]

Should have switched the model to Haiku

▲

peterpanhead 6 hours ago | parent | prev [-]

That's a really gnarly task but I'm shocked it burns 20x that fast. How large is the text? That matters more than anything.

	▲	scrollop 6 hours ago \| parent [-]
		I imagine book sized texts.