Unlees you invest thousands your local ai won't even come close to the cheap cloud llms. Local is only worth it if you care about privacy or have a legitimate usage for the hardware otherwise. Money wise it isn't worth it

▲

Bender 2 days ago | parent | next [-]

I think you bring up a good point about privacy. Companies probably should not be handing over intellectual property to cloud AI third party vendors. Perhaps all of that should stay on-prem and then the cloud vendors could be used to fill in the gaps.

	▲	alchemism 16 hours ago \| parent [-]
		Enterprises running in public clouds have Zero Data Retention policies with the vendor. Routing the ai spend through Azure or AWS usually bring these policies along with it, ie enterprise data and useage is not ingested to retrain the model.

▲

nicman23 a day ago | parent | prev | next [-]

the qwen 27b is quite good for doing a mvp

▲

arijun a day ago | parent | prev [-]

I mean, if you're using one of the $200/month plans, you'd recoup the cost in a year or two.

	▲	TOMDM a day ago \| parent [-]
		You're not running an Opus 4.8/GPT 5.6 tier model on $5k of hardware at a useful Tok/s