| ▲ | lostmsu 2 hours ago | |
Not gonna work, will be starved by inter node bandwidth. | ||
| ▲ | gatuamgb an hour ago | parent [-] | |
You can easily build a localized, access-controlled compute grid using Apple Silicon hardware. Haven't tested but as far as I can see, the key to making it performant would be keeping full models resident on individual nodes rather than attempting to distribute the tensor processing across the network. | ||