SMEs are starting to want local LLMs and it's a nightmare to figure what hardware would work for what models. I am asking devs in my hometown to literally visit their installs to figure combos that work.

▲

CMCDragonkai 9 days ago | parent [-]

Are you installing them onsite?

	▲	eric-burel 8 days ago \| parent [-]
		Some are asking that yeah but I haven't run an install yet, I am documenting the process. This is a last resort, hosting on European cloud is more efficient but some companies don't even want to hear about cloud hosting.