I would love to see a "distributed LLM" system, where people can easily setup a system to perform a "piece" of a "mega model" inference or training. Kind of like SETI@home but for an open LLM (like https://github.com/evilsocket/cake but massive )

Ideally if you "participate" in the network, you would get "credits" to use it proportionally to how much GPU power you have provided to the network. Or if you can't, then buy credits (payment would be distributed as credits to other participants).

That way we could build huge LLMs that area really open and are not owned by any network.

I would LOVE to participate in building that as well.

▲

kennywinker 6 hours ago | parent | next [-]

https://docs.anarchai.org/

This was posted the other day, but only briefly made the front page - seems kinda like what you’re talking about

▲

xtracto 4 hours ago | parent [-]

Oooh thanks a lot. This looks promising. Maybe the only missing thing would be sone kind of (economic) incentive to share GPU power.

Although the ability to use large models "for free" sounds pretty rad.

▲

kennywinker 3 hours ago | parent [-]

I’d volunteer my spare gpu time if i knew it was going to … idk basically anyone except spammers, scammers, and corpos.

	▲	xtracto an hour ago \| parent [-]
		That's why the use has to have some kind of cost. Sure, spammers and scammers will always have spare money, as long as the bounty is higher. But the alternative is "not having Email", because Email can be used by the same bad actors.

▲

5 hours ago | parent | prev | next [-]

[deleted]

▲

xtracto 6 hours ago | parent | prev | next [-]

Oh yeah, and maybe call it "SkyNet" or something.

▲

antipaul 6 hours ago | parent | prev [-]

https://psyche.network/runs