Hi C.J. here, I made a free app that does on device translation using Gemma Translate 4B AI model repackaged for iOS. This allows for after model download, private offline translation locally on your iOS device.

I made this app after trying to talk to my neighbor and service not being great at the bus stop where I drop off my daughter. I have tried to make the app UX easy to use and I really like the default view where the translations appear flipped on each side so you can hold the phone in the middle and each person has a side of the phone.

Hope you enjoy and let me know what you think!

That's kinda neat. Do you do any decoding tricks to handle varying processing capabilities across device models and ipads? Like shortening ctx length or maybe looking into the LFM models that have MoEs with like 1b active?