| ▲ | bhouston 8 hours ago |
| > Github is struggling because AI-boosted coding increased the number of commits 14x in the past year, and the pace is still accelerating. Sure, but how is OpenAI, and Claude handling the increased usage? They are handling it a lot better than Github. Just because you have fast growth does not mean you can not handle it. Instead you have to realize that you are entering into a high growth phase and design around that. It has been clear that we are in a high growth phase for around a year now and Github still hasn't adapted to that properly. At some point you have to admit that Github ready for the moment. |
|
| ▲ | traviswingo 8 hours ago | parent | next [-] |
| GitHub is on Azure. Azure is notorious for being terrible. There was a post here recently from an ex-Azure engineer explaining all of this in a multi-part series. Edit: Found the thread: https://news.ycombinator.com/item?id=47616242 |
| |
| ▲ | Tiberium 8 hours ago | parent [-] | | Isn't a lot of OpenAI infra also on Azure? They seem to be faring better than GitHub. | | |
| ▲ | bhouston 8 hours ago | parent [-] | | I bet OpenAI has failovers to other data centers. I think they have a variety of data center provides all over the place. | | |
|
|
|
| ▲ | tekno45 8 hours ago | parent | prev | next [-] |
| OpenAI and Claude don't accept commits and host PRs? How are they the same? |
| |
| ▲ | bhouston 8 hours ago | parent | next [-] | | I am pretty sure OpenAI and Claude actually have a higher hardware cost per request that Microsoft. Github is actually most just a standard REST API app, although with some caching and git specific operations in the background. It is not as hardware intensive as GPU-based inference per quest with huge contexts and low latency. Also Github's feature offering has been incredibly stable for the last 6 years. There isn't an excuse for it to be unstable like this. | | |
| ▲ | pixelesque 8 hours ago | parent [-] | | Yes, but come on... That's due to the need for ultra-fast memory and inference compute, it's not the same thing. |
| |
| ▲ | dumberquestions 8 hours ago | parent | prev | next [-] | | They're getting increasing demand for tokens at an accelerating pace. | | |
| ▲ | pixelesque 8 hours ago | parent [-] | | Is that the same as storing state in a DB and on a filesystem though? Like, I get there are other features they have, and things like history, but I don't think it's quite the same. Isn't most (not all) of the LLM's resources stateless compute to a large degree? (Not defending MS at all though, I currently can't create a PR on the required branch for my work (won't load the branch list) and their availability is really bad recently). |
| |
| ▲ | fragmede 8 hours ago | parent | prev | next [-] | | Fundamentally, there's incoming requests, an application server, and a database. The devil is in the nature of those requests, and how do you process those requests and stick them in the database. And then serve them back out again. Different application, different database, but fundamentally, it's the same problem. Google managed to do this very well. Microsoft has not. | |
| ▲ | logicchains 8 hours ago | parent | prev [-] | | They're undergoing the same kind of load. Almost every AI commit that's putting pressure on GitHub's servers was written on OpenAI and Anthropic's servers. | | |
| ▲ | simonw 8 hours ago | parent [-] | | Scaling ChatGPT and scaling GitHub are very different problems. For LLMs, prompt handling is effectively stateless. They do try to route follow-up prompts to the same cluster to benefit from prompt caching, but those can be effectively sharded. They also need to write results to storage but that's on a per-customer basis, so also easy to shard. GitHub is a shared space, where commits and issues and PRs need to become instantly available to all readers across all geographies. They have a very different shape of scaling challenge to the LLM vendors. | | |
| ▲ | bhouston 8 hours ago | parent [-] | | > GitHub is a shared space, where commits and issues and PRs need to become instantly available to all readers across all geographies. They have a very different shape of scaling challenge to the LLM vendors. Github data is accessible by all (if open source), but they should be partition-able by individual repository (and their related forks.). Thus while there is more shared state across users, it isn't fully shared state. And they have been working on this semi-shared state design for over 10 years now. |
|
|
|
|
| ▲ | SamBam 8 hours ago | parent | prev | next [-] |
| OpenAI and Anthropic are spending hundreds of billions of dollars that they may never recoup forcing the building massive new data centers in the face of widespread protest. You think GitHub ought to match that? |
| |
| ▲ | bhouston 8 hours ago | parent [-] | | > OpenAI and Anthropic are spending hundreds of billions of dollars that they may never recoup forcing the building massive new data centers in the face of widespread protest. So has Github's owner Microsoft. It's build out is on par with OpenAI and Anthropic. > You think GitHub ought to match that? Microsoft is. The issue is that the software stack is not stable. That is clearly the issue here. It isn't a hardware build out issue. It is related to the architecture of Github. |
|
|
| ▲ | theappsecguy 8 hours ago | parent | prev | next [-] |
| Well they heavily limit free tier usage and for paid users they are charging a tiered pricing model that ramps up very aggressively. Github is a lot more generous in this sense and it has a lot more surface area in terms of the functionality it serves |
|
| ▲ | remus 8 hours ago | parent | prev | next [-] |
| > Sure, but how is OpenAI, and Claude handling the increased usage? By spending tens of billions in investor cash. It is not clear what a sustainable business model looks like for these companies at the moment. > They are handling it a lot better than Github. Are they? Anthropic has fairly frequent issues. There's high growth and then there's demand increasing 10x in a year. For a mature business like github that's a massive, and I can't think of many big businesses who would be able to scale smoothly to accommodate that kind of demand. |
|
| ▲ | baal80spam 4 hours ago | parent | prev [-] |
| > They are handling it a lot better than Github. No, they are not. https://status.claude.com/ https://www.githubstatus.com/ |
