This. The M5’s massive speed up in refill is a good sign.

Apple isn’t expecting wholesale adoption of on-device models this year or next. But all of their design and iteration suggests they see it coming.

Apple has been doing tons of on-device ML for years now, but it's primarily background magic like photo tagging.