Has anyone considered a home server? Assuming mobility is not important if we pick components to match a similar hardware would it be more value for money?

▲

drillsteps5 5 hours ago | parent | next [-]

A decent gaming machine perfectly doubles as your friendly local inference server. Just start llama-server with the model of your choosing and start chatting with it through its Web interface or connect any chat completion-compatible client (agentic or not) which will use REST to send requests and receive responses. From any device on your network. Voila.

▲

LeBit 5 hours ago | parent | prev [-]

Which components are you thinking about?

	▲	prasanthabr 4 hours ago \| parent [-]
		Am unsure - was hoping someone tried this and there is a tested component list of consumer grade pc parts that can do the trick