▲ | brian-armstrong 12 hours ago | |
It's too expensive for that unless you had a pretty generous subscription fee. I think local models are probably best suited for gaming where a decent GPU is already likely present. | ||
▲ | theptip 2 hours ago | parent [-] | |
I think there is a niche for both. Local LLMs are orders of magnitude smaller, so you could imagine cloud bursting for the difficult/important work like generating character portraits. That said it’ll be 10-20x cheaper in a year at which point I don’t think you care about price for this workflow in 2D games. |