Here is a technical comparison to show how Knowledge Distillation works for on-device AI. It has visual maps for the Teacher vs Student models and explains things like 'Dark Knowledge' - https://vectree.io/compare/apple-intelligence-vs-knowledge-d...