Remix.run Logo
Uehreka 6 days ago

I will believe this when I see it. It’s totally possible that those capabilities are locked behind some private API or that there’s some weedsy hardware complication not mentioned that makes them non-viable for what we want to do with them.

aurareturn 5 days ago | parent | next [-]

Already available via Metal: https://x.com/liuliu/status/1932158994698932505

5 days ago | parent [-]
[deleted]
llm_nerd 5 days ago | parent | prev [-]

They might recommend using CoreML to leverage them, though I imagine it will be available to Metal.

The whole point of CoreML is that your solution uses whatever hardware is available to you, including enlisting a heterogeneous set of units to conquer a large problem. Software written years ago would use the GPU matmul if deployed to a capable machine.