| ▲ | bhouston 8 hours ago | |
I am pretty sure OpenAI and Claude actually have a higher hardware cost per request that Microsoft. Github is actually most just a standard REST API app, although with some caching and git specific operations in the background. It is not as hardware intensive as GPU-based inference per quest with huge contexts and low latency. Also Github's feature offering has been incredibly stable for the last 6 years. There isn't an excuse for it to be unstable like this. | ||
| ▲ | pixelesque 8 hours ago | parent [-] | |
Yes, but come on... That's due to the need for ultra-fast memory and inference compute, it's not the same thing. | ||