Remix.run Logo
esafak 2 days ago

You can convert your own ML models to MLX to use them; Apple Intelligence is not the only application.

nullstyle 2 days ago | parent [-]

MLX does not run on NPUs AFAIK; just gpu and cpu. You have to use CoreML to officially run code on the neural engine.

mirsadm 2 days ago | parent [-]

Even then there is no transparency on how it decides what runs on the ANE/GPU etc

sroussey 2 days ago | parent [-]

Correct. OS level stuff get first priority, so you can’t count on using it.

znagengast 2 days ago | parent [-]

Turns out third party actually gets priority for ANE