Hej, I am still working on FisherLoop [1] to learn Swedish (but I have added German, Spanish, French and Italian since). I created FisherLoop because I like audiobooks for language learning but I hated having to pause to look up words + I want to read along the book while listening. With FisherLoop I made "interactive audiobooks" where I use TTS with word level timestamps to highlight the words as they are spoken + I can click on words for the translation.

I am using cerebras for book translations and verb extraction and all LLM related tasks. For TTS I am using cartesia. I have played around with Elevenlabs and they have slightly natural sounding TTS but their pricing is too steep for this project. Books would cost a couple of hundred euros to process.

[1] https://www.fisherloop.com/en/