I love mistral, but that model is... not the best. Maybe try out Gemma 4 e4b, it's a similar size to Mistral 7B, and should run great on your 4070 ("E4B" is slightly misleading naming).

▲

ge96 5 hours ago | parent [-]

Thanks for the tip, what do you use Gemma 4 e4b for?

	▲	redanddead 5 hours ago \| parent [-]
		some say it’s a miniaturized gemini model it’s good at writing, coding, decently intelligent you can try it on nvidia nim