Show HN: Samosa Chat - Run Qwen3.6-35B-A3B Locally on a 16 GB Mac

prabhanjana_c 7 hours ago | parent | next [-]

Very interesting. I am always curious on llama.cpp and vllm. All the best for samosa inference engine. One reason I am not running local models on my Mac now a days, is My Mac book pro is getting heated more. Otherwise would love to run couple (at least 1 to 3) of local models continuously.

▲

aanet 9 hours ago | parent | prev | next [-]

+1 for pairing Samosa with Chāt :D :D

	▲	dwa3592 9 hours ago \| parent [-]
		i was pleasantly surprised to find out it hadn't been done until now.

▲

MrGrinchh 9 hours ago | parent | prev [-]

This is pretty sick. 7tokens/second is not fast but still seems useful.