▲ | Uehreka 6 days ago | |||||||
I will believe this when I see it. It’s totally possible that those capabilities are locked behind some private API or that there’s some weedsy hardware complication not mentioned that makes them non-viable for what we want to do with them. | ||||||||
▲ | aurareturn 5 days ago | parent | next [-] | |||||||
Already available via Metal: https://x.com/liuliu/status/1932158994698932505 | ||||||||
| ||||||||
▲ | llm_nerd 5 days ago | parent | prev [-] | |||||||
They might recommend using CoreML to leverage them, though I imagine it will be available to Metal. The whole point of CoreML is that your solution uses whatever hardware is available to you, including enlisting a heterogeneous set of units to conquer a large problem. Software written years ago would use the GPU matmul if deployed to a capable machine. |