A smart performant local model will be the equivalent of having good anti-virus and firewall software. It will be the only thing between you and wrong prompts being sent every which way from which app.

We’re probably three or four years away from the hardware necessary for this (NPUs in every computer).

▲

ec109685 5 days ago | parent [-]

A local LLM wouldn’t have helped at all here.

▲

ivape 5 days ago | parent [-]

You can’t imagine a MITM LLM that sits between you and the world?

	▲	QuadmasterXLII 5 days ago \| parent \| next [-]
		Local llms can get offline searched for vulnerabilities using gradient based attacks. they will always be very easy to prompt inject.
	▲	solid_fuel 4 days ago \| parent \| prev [-]
		I can't imagine how such a thing would _help_, it seems like it would just be another injection target.