Cool experiment. It will be amazing if this can match the WER of the best open weight models at better speed.
People aren't paying enough attention to how great EmbeddingGemma 2 and Gemma 4 are.