Sorry if this is an easy-answerable question - but by open we can download this and use totally offline if now or in the future if we have hardware capable? Seems like a great thing to archive if the world falls apart (said half-jokingly)

▲

Tepix 6 hours ago | parent | next [-]

You could buy five Strix Halo systems at $2000 each, network them and run it.

Rough estimage: 12.5:2.2 so you should get around 5.5 tokens/s.

	▲	j-bos 6 hours ago \| parent [-]
		Is the software/drivers for networking LLMs on Strix Halo there yet? I was under the impression a few weeks ago that it's veeeery early stages and terribly slow.

▲

fragmede 6 hours ago | parent | prev | next [-]

Yes but the hardware to run it decently gonna cost you north of $100k, so hopefully you and your bunkermates allocated the right amount to this instead of guns or ammo.

▲

Carrok 7 hours ago | parent | prev | next [-]

Yes.

▲

cmrdporcupine 7 hours ago | parent | prev [-]

Yes, but you'll need some pretty massive hardware.