| ▲ | sky2224 3 hours ago | |
This is part of the reason why I'm really worried that this is all going to result in a greater economic collapse than I think people are realizing. I think companies that are shelling out the money for these enterprise accounts could honestly just buy some H100 GPUs and host the models themselves on premises. Github CoPilot enterprise charges $40 per user per month (this can vary depending on your plan of course), but at this price for 1000 users that comes out to $480,000 a year. Maybe I'm missing something, but that's roughly what you're going to be spending to get a full fledged hosting setup for LLMs. | ||
| ▲ | subarctic 3 hours ago | parent | next [-] | |
Out of curiosity, how many concurrent users could you get with a hosting setup at that price? If let's say 10% of those 1000 users were using it at the same time would it handle it? What about 30% or 100%? | ||
| ▲ | merlinoa 3 hours ago | parent | prev [-] | |
Most companies don't want to host it themselves. They want someone to do it for them, and they are happy to pay for it. If it makes their lives easier and does not add complexity, then it has a lot of value. | ||