| ▲ | Incipient 40 minutes ago | |
This would depend hugely on the price of electricity, however I'm pretty sure where I am (at roughly 25c/kwh in usd) the price of running qwen costs more than 6.1-luna per token. So other than privacy (which doesn't matter for my work) there isn't any justification for running locally. Is privacy purely what people justify local models on? | ||
| ▲ | stkdump 21 minutes ago | parent [-] | |
Doesn't Qwen3.8 do much better than Luna? | ||