If you've been around Macs long enough this is very much in Apple's wheelhouse. They already do something similar with Final Cut Pro rendering, Logic Pro, Grand Central Dispatch, and XCode distributed CI/CD. Apple HQ is probably sitting on 1000s of nodes, high powered MBPs, iMacs, that could do lots of inference work overnight.

[0] https://en.wikipedia.org/wiki/Grand_Central_Dispatch

[1] https://developer.apple.com/documentation/dispatch

Reminds me of Incredibuild.