How do they go away with local models? It's a bug of all LLMs not just cloud vs local. As mentioned in another comment, they did test local models here too and those failed as well.

▲

ux266478 an hour ago | parent [-]

As parent implies, they're testing the wrong control mechanism. Why are you using policies instead of real controls over the weights and inference pipeline?

Well the answer is that VC-backed companies decided AI is not a domain expert tool for highly competent technical users, it's a magic oracle for the lowest common denominator. So you don't get any of the actually useful controls, just context engineering like that's fucking sane at all. It's like trying to program by navigating a git history. Not writing any new code, you don't have the ability to do that. No, you exclusively have the ability to move around a git history and cherry pick things. It's insulting that they want to charge money for this shit.

	▲	Aurornis 13 minutes ago \| parent \| next [-]
		> Well the answer is that VC-backed companies Look, I enjoy local LLMs as much as anyway, but I think there is some motivated reasoning happening in this thread to try to make local LLMs sound like a utopia against those evil VCs. Local LLMs suffer from the same problems.
	▲	TiccyRobby 31 minutes ago \| parent \| prev \| next [-]
		And what is the difference between cloud modeld vs local inference regarding this? It is still unclear in this thread - asking out of curiosity.
	▲	giancarlostoro an hour ago \| parent \| prev [-]
		> just context engineering like that's fucking sane at all. Meanwhile every model is at a battle to figure out how to stop you from jailbreaking it, which I assume takes a toll on your ability to prompt. Heck, if you read r/Claude and related subs during the early release of Fable there were a lot of complaints that it would downgrade you heavily.