I run mlx models with omlx[1] on my mac and it works really well.

[1] https://github.com/jundot/omlx

Holy hell, how new is this? I've never heard of it, looks great!