> And I can always see its full thoughts, don't have to worry about where my data is getting sent, and know it can't get secretly nerfed.

For this reason I wonder if local models are a potential business opportunity. Provide the service to engineering teams to give them a pre-built and setup GPU rig they can run in a closet. No need to worry about all the things you mentioned and clients can rest-assured their data isn't disappearing into a sketchy data center. There might be regulatory reasons that make on-prem setups appealing as well.

▲

amoshebb 3 hours ago | parent | next [-]

This is, as far as I know, the business model of coys like mistral and cohere

▲

suncemoje 3 hours ago | parent | prev | next [-]

On-premise (1960-2010) -> Cloud (2010-2026) -> On-premise (2026+)?

▲

indoordin0saur 3 hours ago | parent [-]

I think that's overstated, but the loss of trust companies have with the big AI players is pretty serious. Not a big deal if your app is for sharing cat videos, but if you're medical or wealth management or a government contractor or the like enterprise clients really like to see good data security policies.

	▲	lelanthran 11 minutes ago \| parent \| next [-]
		> Not a big deal if your app is for sharing cat videos, but if you're medical or wealth management or a government contractor or the like enterprise clients really like to see good data security policies. If this mattered to them, they wouldn't be running so much in the cloud or in proprietary software that they have no ability to air-gap. If companies ever cared about this, Windows would not be dominant on the desktop.
	▲	suncemoje 3 hours ago \| parent \| prev [-]
		Agree. I also wonder how zero e.g., Claude Enterprise ZDR really is, and what their data pipeline actually looks like.

▲

cyanydeez 3 hours ago | parent | prev [-]

I think the next step to anyone but overbloated USA models is to follow https://chatjimmy.ai/ with one of the qwen models. If they can mass produce something at relative cost, these would be awesome sidecars.