| ▲ | speedgoose 2 hours ago | |
It was for my team. Running useful LLMs on battery power is neat for example. Some simply care a bit about sustainability. It’s also good value if you want a lot of memory. What would you advice for people with a similar budget? It’s a real question. | ||
| ▲ | PlatoIsADisease 2 hours ago | parent [-] | |
But you arent really running LLMs. You just say you are. There is novelty, but not practical use case. My $700, 2023, 3060 laptop runs 8B models. At the enterprise level we got 2, A6000s. Both are useful and were used for economic gain. I don't think you have gotten any gain. | ||