| ▲ | xienze 10 hours ago | |
> So you could see small LLM co-operatives working out, yeah. Only on a pay-per-token basis, I think. Unless it's a very tight-knit circle of folks. Fixed monthly subscription costs I doubt would work in that model. Because you'll get the inevitable: someone pegging the service 24/7 because it's "unlimited" while everyone else suffers. | ||
| ▲ | dofm 10 hours ago | parent [-] | |
Well, many of us who shared hardware also ran monitoring to make sure the share was fair; there used to be a whole industry for that sort of quota stuff. You can presumably hard-limit LLMs the same way — total, burst quotas etc. (Suddenly getting a very fun flashback to the environment in which someone first explained Markov chains to me — MediaMOO. A text-based chat environment with configurable limits on the number of CPU "ticks" you were allowed in order to do things) | ||