Remix.run Logo
▲ Incipient 40 minutes ago

This would depend hugely on the price of electricity, however I'm pretty sure where I am (at roughly 25c/kwh in usd) the price of running qwen costs more than 6.1-luna per token. So other than privacy (which doesn't matter for my work) there isn't any justification for running locally. Is privacy purely what people justify local models on?

▲stkdump 21 minutes ago | parent [-]

Doesn't Qwen3.8 do much better than Luna?