Remix.run Logo
▲ forgotpwd16 4 hours ago

For anyone, if not everyone, that finds site unintuitive, a technical report is also available[0]. Fwiw some other prior work, not cited in previous report, on remote GPU offloading is GVirtuS[1], which originated for use on HPCs[2] but later pivoted in low-power devices[3], and patents by Lenovo[4] and Nvidia[5] (abandoned; imo quite vague but worths showing that it's something that has existed as an idea).

That said, although title here focuses on one, WiCi seems to pursue a second related idea, that being SSD-backed LM inference. Code for this is open-sourced at https://github.com/wici-ai/inferssd.

[0]: https://arxiv.org/abs/2608.24204 [1]: https://github.com/gvirtus/GVirtuS [2]: https://link.springer.com/chapter/10.1007/978-3-642-15277-1_... [3]: https://onlinelibrary.wiley.com/doi/abs/10.1002/cpe.4286 [4]: https://patents.google.com/patent/US20250191108A1 [5]: https://patents.google.com/patent/US20140122558A1