Why not leverage Apple Foundational models?

Downloads will already be on the machine.

https://developer.apple.com/documentation/foundationmodels

I've tried, they were really bad for this use case.