Apple's on-device transcription model is about 3x slower than their reported results on my more powerful computer, with a similar error rate in my test (which I consider pretty good results)

I'll test theirs too if I get around to it

Here's a sample CLI wrapping the apple model and providing a simple benchmark: https://github.com/llimllib/transcribe

update: doesn't seem like they provide their model and I don't feel like trying to dig it out of their app bundle, so I'm not going to test this one

▲

s3p 2 hours ago | parent | next [-]

Is it even worth using apple's? Maybe they have improved it but when they first started using it to transcribe voice memos it was laughably bad (in my experience). I defaulted to whisper.cpp

	▲	ChrisMarshallNY 34 minutes ago \| parent \| next [-]
		I suspect Apple's strengths are in multi-language support. I use their on-device translation in my apps. Works pretty well. ChatGPT's context-aware translation is better, but it's not on-device.
	▲	llimllib 2 hours ago \| parent \| prev [-]
		apple's is 5x faster than `large-v3-turbo` with whisper.cpp and in my test had somewhat worse performance, so it's a tradeoff

▲

bigtex 2 hours ago | parent | prev [-]

With MacWhisper you can select the Apple models, it took almost 4x as long to transcribe the same file versus this software and MacWhisper/Parakeet3.

	▲	llimllib an hour ago \| parent [-]
		interesting! I only tested against Parakeet v2 because my agent suggested it would be faster for English transcription (v3 is multilingual but somewhat slower, it suggested) On my bench, parakeet-tdt-0.6b-v2 is 2x slower I wonder if you're using different Apple models when you go through that app? I don't know