Remix.run Logo
darkpicnic 6 hours ago

cocompute.ai is already doing this really well.

SwellJoe 6 hours ago | parent | next [-]

Is it? I don't see anything on the website about splitting a model across multiple devices, only about putting local models on the internet, a wholly orthogonal problem (which is already easy with existing tools, since models use an http API).

darkpicnic 6 hours ago | parent [-]

Good point. I know cocompute is working on splitting, but it’s not there yet; I was referring to the round-robin delegation within a trusted pool. Mesh LLM looks great too!

dnoberon 6 hours ago | parent | prev [-]

Cool, always good to have more in the ecosystem. I love Iroh and hope this continues to succeed.