I’ve been using these in my terminal for correcting errors and suggesting commands https://github.com/paul-oms/prompt

Surprisingly capable on an m1 8gb (in my opinion this is the smallest machine that local ai needs to run on)

Interesting. Have you had issues with the model safety restrictions at all? They seem rather aggressive for normal usage, I wonder if limiting to command line options keeps things safe enough they stay out of the way.

	▲	cj00 a day ago \| parent \| next [-]
		Yeah I found the safety restrictions really aggressive. Enough that I just gave up and used Gemma instead.
	▲	zf00002 a day ago \| parent \| prev [-]
		I have my firewall events get reviewed by the local model on my mac studio. I had to stop sending the full event because the model would refuse some requests.

▲

lukisk 13 hours ago | parent | prev [-]

i tested it for a simple swift ui application for reviewing text grammar. It was unusable, i switched back to sonnet.