Remix.run Logo
▲ serf 6 hours ago

i'm gettin between 200-320 tok/s on a 5070ti with 131k context on llamacpp and no tuning.

very nice.

I can't speak to the intelligence of it yet.

these small agentic-focused models are a lot of fun to play with if you haven't yet.

▲sheephess44 4 hours ago | parent [-]

[flagged]