| ▲ | vladgur 2 hours ago | |
At cost of power at $.45kwh here and dual 3090 setup easily approaching 1kw per hour at 120 tok/sec, latest Luna is cheaper per million tokens. Your electrical costs are likely less than mine though | ||
| ▲ | K0balt an hour ago | parent | next [-] | |
Yeah electric costs are nil on the microgrid but capacity is limited. | ||
| ▲ | selicos an hour ago | parent | prev [-] | |
I'm working off a 128gb Strix system on mostly hydro and it's worth it for me. Qwen 3.8 27B and Flash Next, Gemma 4 and MOE models. It Keeps my thinking and methods local while moving at a speed I can actually read and think about. It can be annoying when you're running something long and realize there is an issue. But hey, I'm not wasting paid tokens. Reset and try again. I've probably thought of a better way by then too. | ||