Remix.run Logo
Tepix 7 hours ago

You could buy five Strix Halo systems at $2000 each, network them and run it.

Rough estimage: 12.5:2.2 so you should get around 5.5 tokens/s.

j-bos 7 hours ago | parent [-]

Is the software/drivers for networking LLMs on Strix Halo there yet? I was under the impression a few weeks ago that it's veeeery early stages and terribly slow.

Tepix 29 minutes ago | parent [-]

Llama.cpp with its rpc-server