Remix clone Hacker News

new | show | ask | jobs Github

syntaxing 3 hours ago

Really looking forward to this, 27B is a struggle with a strix halo and Laguna 2.1 can do stupid things for tooling calls.

cpburns2009 3 hours ago | parent | next [-]

Yeah 27B is way too slow for the Strix Halo. Laguna was better but still slow when I tried it. Qwen3.6 35B is still the best today.

SparkyMcUnicorn 2 hours ago | parent | next [-]

Have you given Ornith-1.5-35B a shot?

It's been a pretty decent step up for me compared to Qwen3.6

https://news.ycombinator.com/item?id=49362401

	▲	cpburns2009 an hour ago \| parent [-]
		I know it benchmarks very well. I haven't tried it yet though.

3 hours ago | parent | prev | next [-]

[deleted]

puzzlingcaptcha 3 hours ago | parent | prev | next [-]

What sort of pp/tg speed do you get on a Strix Halo?

cpburns2009 2 hours ago | parent | next [-]

This is the best I got, all with Unsloth's quantizations.

Laguna-S-2.1:UD-Q4_K_XL (no MTP) pp=186.4 t/s tg=27.8 t/s

Qwen3.6-35B:UD-Q4_K_XL (with MTP) pp=404.4 t/s tg=83.2 t/s

Qwen3.6-27B:UD-Q4_K_XL (recorded pre-MTP) pp=343 t/s tg=12.1 t/s

Laguna actually performed better than I remembered. I thought it was slower.

	▲	an hour ago \| parent [-]
		[deleted]

ascii0eks84 an hour ago | parent | prev [-]

What are pp/tg? I get 30t/s on 27B qwen.

	▲	throwawayffffas an hour ago \| parent [-]
		pp is prompt processing how fast it processes the prompt. Tg is token generation how fast, it generates tokens.

cyanydeez 3 hours ago | parent | prev [-]

it'll hopefully improve with more MoE and half the prefill/generation. I think it's the sweet spot for the strix halo for smarter or vibe tasks.

corysama an hour ago | parent | prev [-]

So, I know https://cactuscompute.com/needle is designed only to enable tool calling on tiny devices. But, I wonder if anyone has used it as a CPU-side mediator between a tool and a GPU-side local LLM making semi-natural-language tool requests...