| ▲ | Gecko4072 an hour ago | |
They will cost an insane amount as well. Maybe less than subscriptions or tokens. But running massive models on laptops with batteries and poor cooling doesn’t make much sense. | ||
| ▲ | LeBit 37 minutes ago | parent [-] | |
Until hiding PII from the cloud LLM is a resolved issue, running local LLMs will remain a necessity. There are workplaces that refuse to use LLMs because they fear the devs will expose sensitive data without care. | ||