It's worth remembering that Apple is releasing a new framework (Core AI) this fall that goes beyond the Pytorch and Tensorflow workloads that the decade old Core ML framework allowed.

> Core AI allows your app to use the latest model architectures and inference techniques across the CPU, GPU, and Neural Engine.

https://developer.apple.com/documentation/coreai