| ▲ | GitHub is once again down(githubstatus.com) |
| 314 points by MattIPv4 4 hours ago | 159 comments |
| |
|
| ▲ | guywithabike 3 hours ago | parent | next [-] |
| The worst part of all this is that GitHub's CTO and VP of Engineering sent out the usual "here's what we'll do to fix things" letter to their larger customers and, without exaggeration, it boiled down to: 1) "Here's a bunch of stuff we already did!" which... clearly isn't working, and 2) "We're continuing our Azure migration." also clearly not working. So needless to say, if you depend on GitHub for critical business operations, you need to start thinking about what a world without GitHub looks like for your business and start working your way toward that. I know my confidence in GitHub's engineering leadership is at rock bottom. |
| |
| ▲ | Eji1700 3 hours ago | parent | next [-] | | I could sorta see a situation where the reality is "we're in the middle of a miserable transition and it'll clean up when we're done" but I don't think anyone has confidence that's all it is at this point. | | |
| ▲ | everforward 3 hours ago | parent | next [-] | | Even that doesn’t really make sense to me, unless they’ve done it in a way where everything has to move at once. Everywhere I’ve worked, if a migration is causing this much downtime then you kill the migration or slow it down. If every change has a 10% chance of bringing the site down, you only do a change every week or two until you can work out the kinks. | | |
| ▲ | shrikant an hour ago | parent | next [-] | | ...or you keep fighting forward with the migration, because if it's seen as a failure then some pretty big heads will have to roll... | |
| ▲ | acedTrex 2 hours ago | parent | prev [-] | | I mean, they are seemingly breaking every week or two so that might be what they are doing. |
| |
| ▲ | suriya-ganesh 2 hours ago | parent | prev [-] | | also it should be noted that LinkedIn had a 5 year plan of migrating everything to azure but abandoned it after a year. |
| |
| ▲ | sysworld 3 hours ago | parent | prev | next [-] | | ooooh, they're migrating to Azure, now everything makes sense. | | |
| ▲ | spondyl 2 hours ago | parent | next [-] | | Here are some relevant excerpts from an October 2025 article[1]: > In a message to GitHub’s staff, CTO Vladimir Fedorov notes that GitHub is constrained on capacity in its Virginia data center. “It’s existential for us to keep up with the demands of AI and Copilot, which are changing how people use GitHub,” he writes. > The plan, he writes, is for GitHub to completely move out of its own data centers in 24 months. “This means we have 18 months to execute (with a 6 month buffer),” Fedorov’s memo says. He acknowledges that since any migration of this scope will have to run in parallel on both the new and old infrastructure for at least six months, the team realistically needs to get this work done in the next 12 months. If you consider that six month parallel window to have started from the time of the October memo (written presumably at the start of October), then that puts us currently or past the point where they would have cut off their old DC and defaulted to Azure only. Whether plans or timelines changed, I have no idea of course but the above does make for a convenient timeline that would explain the recent instability. Of course, it could also just be symptomatic of increased AI usage generally and the same problems might have surfaced at a software level regardless of whether they were in a DC or on Azure. Putting that nuance aside, personally I like the idea that Azure is simply a giant pile of shit operated by a corporation with no taste. [1]: https://thenewstack.io/github-will-prioritize-migrating-to-a... | | |
| ▲ | Barrin92 2 hours ago | parent [-] | | >It’s existential for us to keep up with the demands of AI and Copilot if by chance the CTO reads this, as a user of GitHub I would find it really existential if GitHub continues functioning as a reliable hub for git workflows (hence the name), and I have the strong suspicion nobody except for the shareholders gives a lick about copilot or 'AI' if it makes the core service the site was designed for unusable | | |
| ▲ | ncruces an hour ago | parent | next [-] | | AI and Copilot increase the load on git workflows. | |
| ▲ | jwoq9118 2 hours ago | parent | prev [-] | | For GitHub to remain profitable they have to appease those shareholders you mentioned. | | |
| ▲ | denkmoon an hour ago | parent | next [-] | | Why? What is the correlation between profit and shareholder sentiment (besides the fact that shareholders want said profits)? They don't really influence the operation of the business meaningfully. | |
| ▲ | conception an hour ago | parent | prev [-] | | Incorrect. They need to appease/trick/threaten/etc those that are paying for their services. Shareholders just demand they do so at the greatest (often short term) rate. |
|
|
| |
| ▲ | comice 2 hours ago | parent | prev | next [-] | | yeah currently working with Azure. what a PITA. I wonder if the extended downtime is just due to the on-call engineers waiting for their azure auth tokens to refresh within azure's own damn network. | |
| ▲ | pm90 2 hours ago | parent | prev | next [-] | | i heard that they asked LinkedIn to do this too and they either refused or their systems were too complex so they refused to. Maybe that explains why LI availability seems ok | |
| ▲ | kleene_op 2 hours ago | parent | prev | next [-] | | Azure, the color of BSOD | |
| ▲ | cyanydeez 2 hours ago | parent | prev [-] | | they're not just migrating to Azure, they're vibrating to Azure! |
| |
| ▲ | packetlost 3 hours ago | parent | prev | next [-] | | I second this. I'm done. | |
| ▲ | ryukoposting 2 hours ago | parent | prev [-] | | Is "migrating to Azure" the new "migrating to SAP?" | | |
|
|
| ▲ | proc0 3 hours ago | parent | prev | next [-] |
| It's starting to really look like the AI effect. It might be coincidence but I've noticed a lot more downtime and bad software lately. The last Nvidia drivers gave me a blue screen (last week or so), and speaking about Windows, I froze updates last year because it was clear they were introducing a bunch of issues with every update (not to mention unwanted features). I like AI but actually not for coding because code quality is correlated to how well you understand the underlying systems you're building on, and AI is not really reasoning on this level at all. It's clearly synthesizing training data and it's useful in limited ways. |
| |
| ▲ | someperson 2 hours ago | parent | next [-] | | GitHub has been unreliable since before AI. Though it's definitely gotten far worse. Seemingly the decline started with the Microsoft acquisition in 2018, and subsequent "unlimited private repository" change in 2019 (to match Gitlab's popular offer) | | |
| ▲ | hparadiz 2 hours ago | parent [-] | | One example is the search being broken for CI logs. It takes over your browser's search hotkey too. What happens is every stage of the log is collapsed so the search doesn't work until you trigger the expansion but if you attempt to search before expanding the search will never work after it's been initialized. It's pretty infuriating when you're trying to find something in a giant build log. |
| |
| ▲ | ivanjermakov an hour ago | parent | prev | next [-] | | I bet on rushed Azure migration. A lot can go wrong it devops. | |
| ▲ | newbish 2 hours ago | parent | prev [-] | | I think maybe it's not that GitHub is using AI, but that the amount of AI slop going into GitHub may be more than they expected. | | |
| ▲ | qbane 2 hours ago | parent [-] | | Productivity is finite. If you pivot entirely to the AI stack, you're going to lose bandwidth for everything else. It's an opportunity cost problem. |
|
|
|
| ▲ | paxys 3 hours ago | parent | prev | next [-] |
| Took a full 8 years for a Microsoft acquisition to go to shit, which is probably a record. Kudos to the Github team for holding out this long. |
| |
| ▲ | AndroTux 3 hours ago | parent | next [-] | | I’m still baffled that Minecraft is doing so well, despite the whole Bedrock thing. At this point I think Microsoft just forgot that they bought Mojang. | | |
| ▲ | PaulKeeble 2 hours ago | parent | next [-] | | Its had its fair share of outages and outrageous changes that overreach the bounds as well. Its more stable than github is but its had at least 2 sessions of downtime this year that I recall and they were both quite long (day length). | |
| ▲ | spauldo 2 hours ago | parent | prev | next [-] | | They'd lose a whole lot of users if they killed Java edition, since the modded community is so large. They'd quickly find one of the Minecraft clones reaching feature parity. And there's no good reason for it - it's not like Java is a threat anymore. | | |
| ▲ | AndroTux 2 hours ago | parent [-] | | Exactly. So why isn't Microsoft doing just that? Isn't that how Microsoft usually handles things? Just look at Xbox. They essentially screwed up everything they could and then some. |
| |
| ▲ | cedws 2 hours ago | parent | prev | next [-] | | If I remember correctly UK players can no longer chat at all until they verify their ID. | |
| ▲ | 7777332215 2 hours ago | parent | prev [-] | | Minecraft is a trick up their sleeve yet to be used. Manipulate and indoctrinate the youth. | | |
| |
| ▲ | merlindru 3 hours ago | parent | prev | next [-] | | GitHub has always been incredibly outage riddled no? This is not a MSFT thing | | |
| ▲ | nine_k 3 hours ago | parent [-] | | I don't remember that happening so much (if ever) in, say, 2016. But the frequency of noticeable incidents seemingly has been rising steadily since around 2023. The Azure migration apparently only exacerbated it. | | |
| ▲ | 0x457 40 minutes ago | parent | next [-] | | I remember seeing unicorn daily and "webhook delivery delayed" weekly. I think it got better, but also they got more traffic, now millions of agents read files separately over and over again. IMO it's much better now. | |
| ▲ | georgel 2 hours ago | parent | prev | next [-] | | I remember it going down semi-regularly in the 2013+ era, and seeing HN posts about it. Especially if you were using a package manager reliant on GitHub like Cocoapods. It seems to me it is more "impactful" on the dev community now that they have gone past just being a centralized Git server for the team, to being the thing that does deploys and all sorts of other things. | |
| ▲ | gbear605 2 hours ago | parent | prev [-] | | Circa 2019, my office had a bell that we would ring whenever GitHub had an outage, and it was rung several times per week. |
|
| |
| ▲ | xeonmc 3 hours ago | parent | prev | next [-] | | How fast was Skype? | | | |
| ▲ | htrp 3 hours ago | parent | prev [-] | | To be fair a bunch of this is because the CEO after Nat Friedman (Thomas Dohmke) was pushed out in August 25. | | |
| ▲ | carlosft 2 hours ago | parent | next [-] | | And a ton of the top end ruby staff have left. Many of them ended up at shopify. There is a growing about of non ruby/rails code at github, but most of the system that people think of when they think github are ruby/rails. | | | |
| ▲ | workfromspace 3 hours ago | parent | prev [-] | | Who was also the last CEO, right? Is this a coincidence? |
|
|
|
| ▲ | inaros 3 hours ago | parent | prev | next [-] |
| Every day more Microsofty...they should rename to "Your Repository Needs To Restart To Apply Updates" |
| |
| ▲ | Waterluvian 3 hours ago | parent | next [-] | | It's now safe to turn off your expectations. | |
| ▲ | kenhwang 3 hours ago | parent | prev | next [-] | | I wonder what the average career tenure of the userbase here is now, because Github was slow and flaky well before Microsoft got involved. Maybe it wasn't as noticeable when Github had less features, but our CI runners and other automation using the API a decade ago always had weekly issues caused by Github being down/degraded. | | |
| ▲ | jmtulloss an hour ago | parent [-] | | The best stretch Github ever had was post-acquisition when Nat Friedman as CEO. |
| |
| ▲ | bartread 3 hours ago | parent | prev | next [-] | | "It looks like you're trying to develop some software. Would you like help? - Get help with developing the software - Just develop the software without help [ ] Don't show me this tip again" | |
| ▲ | morkalork 2 hours ago | parent | prev | next [-] | | Would you like to setups repository backups with OneDrive? | |
| ▲ | amarant 3 hours ago | parent | prev [-] | | Lol, someone should make a pre -commit hook that reboots your computer with a message like this! | | |
|
|
| ▲ | mememememememo 3 hours ago | parent | prev | next [-] |
| Down? No sir we are not down. There are elevated error rates and degraded performance. |
| |
| ▲ | karim79 3 hours ago | parent | next [-] | | The update to .NET framework went badly and we need to reinstall Windows. | |
| ▲ | xtracto 2 hours ago | parent | prev [-] | | An isolated group of customers are experiencing elevated error rates and degraded performance. FTFY.
(I've read AWS word it like that) | | |
|
|
| ▲ | stevepotter 3 hours ago | parent | prev | next [-] |
| I'm just going to stand by until Microsoft is back in everyone's good graces again by releasing some oss software that we all swoon over |
| |
| ▲ | kace91 2 hours ago | parent | next [-] | | Is that a cyclical thing? I went through the VS code+typescript good graces era but I didn't know there were previous cycles. | | |
| ▲ | RevEng 2 hours ago | parent [-] | | Not that I remember. VS Code was a surprising turnabout for a company that was both adamantly closed and threw FUD around like monkeys in a zoo. |
| |
| ▲ | philipallstar 2 hours ago | parent | prev [-] | | You've been here before! |
|
|
| ▲ | hirako2000 3 hours ago | parent | prev | next [-] |
| I'm glad I moved over to forgejo. Being selfhosted, the UI loads faster. Most importantly, the thing is always responsive. |
| |
| ▲ | mfenniak 3 hours ago | parent [-] | | As a developer working on Forgejo -- glad you like it! | | |
| ▲ | hirako2000 2 hours ago | parent [-] | | It hosts all the repositories backing applycreatures, we ran dozens of git projects on the same instance, have teams, you guys did a phenomenal work. I would say it's even easy to customise. https://foja.applycreatures.com Edit: it has a wonderful API so I posted the link it may tempt some to ditch MS/Azure hub. |
|
|
|
| ▲ | odiroot 3 hours ago | parent | prev | next [-] |
| They invented the perfect solution to stop supply chain attacks. |
| |
|
| ▲ | dsm4ck 3 hours ago | parent | prev | next [-] |
| Microslop at it again |
| |
|
| ▲ | ahstilde 3 hours ago | parent | prev | next [-] |
| github is at one nine, basically: https://news.ycombinator.com/item?id=47428035 |
| |
| ▲ | msandford 3 hours ago | parent | next [-] | | I once worked at a place with more micro services than engineers. We joked about "we have as many 8s of uptime as you need!" | | |
| ▲ | 0x3f 3 hours ago | parent | next [-] | | > I once worked at a place with more micro services than engineers. Currently consulting somwhere with 30 services per engineer. I cannot convince them this is hell. Maybe that makes it my personal hell. | | |
| ▲ | NooneAtAll3 7 minutes ago | parent | next [-] | | as a person that never touched webdev, I have a question how is such service spam different from unix "small functions that do one thing only" culture? why in unix case it is usually/historically seen as nice, while in web case it makes stuff worse? | |
| ▲ | KaiserPro 2 hours ago | parent | prev | next [-] | | "Its like family here!" In that every night you're playing murder mystery, and its never fun. | |
| ▲ | msandford 2 hours ago | parent | prev [-] | | Oooof that's rough. One strategy to convince is to get someone less technical than you to sit by you while you try and trace everything from one error'd HTTP request from start to finish to diagnose the problem. If they see it takes half a day to check every call to every internal endpoint to 100% satisfy a particular request sometimes that can help. Also sometimes they just think "this is a bunch of nerd stuff, why are you involving me?!" So it's not foolproof. | | |
| ▲ | 0x3f 2 hours ago | parent [-] | | Oh, my non-technical boss agrees with me already. It's actually the engineers who've convinced themselves it's a good setup. Nice guys but very unwilling to change. Seems they're quite happy to have become 'experts' in this mess over the last 5-10 years. Almost like they're in retirement mode. The real solution is probably to leave, but the market sucks at the moment. At least AI makes the 10-repos-per-tiny-feature thing easier. |
|
| |
| ▲ | anotherjesse an hour ago | parent | prev | next [-] | | We pride ourself on 9 5s! | |
| ▲ | the_real_cher 3 hours ago | parent | prev [-] | | seven nines? That's nothing , bro we got twelve eights! | | |
| |
| ▲ | rdtsc 3 hours ago | parent | prev | next [-] | | From five nines to nine fives | |
| ▲ | Imustaskforhelp 3 hours ago | parent | prev [-] | | 9% ? /s (though To be honest I genuinely wouldn't be surprised if things go down so bad too at this point either) | | |
|
|
| ▲ | mayhemducks an hour ago | parent | prev | next [-] |
| Does anyone else ever think "that code I just pushed into my repo just took down all of github..." whenever it goes down around the same time you sync your changes? |
|
| ▲ | gchamonlive an hour ago | parent | prev | next [-] |
| Just moved a project of mine to Gitlab. Created this very simple component with codex that will keep a mirror updated on GitHub for me, so I can focus development on Gitlab. https://gitlab.com/gabriel.chamon/ci-components/-/tree/main/... |
|
| ▲ | zelphirkalt 2 hours ago | parent | prev | next [-] |
| Man, a while ago I thought: "It happens often, alright, but every 2 weeks? Sounds like a slight exaggeration." But it really is every 2 weeks, isn't it? If I imagine in a previous job anything production being down every 2 weeks ... phew, would have had to have a few hard talks and course corrections. |
| |
| ▲ | genewitch 2 hours ago | parent [-] | | i once fixed a site going down several times a year with two t1.micro instances in the same region as the majority of traffic. Instantly solved the problem for what, $20/month? Another site was constantly getting DDoS by Russians who were made we took down their scams on forums, that had to go through verisign back then, not sure who they're using now. They may have enough aggregate pipe it doesn't matter at this point |
|
|
| ▲ | jrm4 2 hours ago | parent | prev | next [-] |
| Do your part; remind people that Github is not git. Git is decentralizable and people should know this. |
|
| ▲ | rco8786 19 minutes ago | parent | prev | next [-] |
| GH is ripe for a disruptor right now. |
|
| ▲ | jeppester 3 hours ago | parent | prev | next [-] |
| At this rate it will be a matter of time before a "Github is up" parody site reaches the top of HN |
|
| ▲ | 0xbadcafebee an hour ago | parent | prev | next [-] |
| I'm surprised nobody has tried to throw together a commercial alternative to GitHub. 50% of it is available as FOSS, the other 50% you can vibecode in a month (you can vibecode reliably, Microsoft/Google just suck at it). Afaict, reason we all keep using GitHub is it has a million features and isn't as ugly, difficult and slow as GitLab. (sorry GitLab, I love your handbook, hate your UX) |
|
| ▲ | corvad 3 hours ago | parent | prev | next [-] |
| And this is why I self host a lot of my Git stack with Gerrit... |
| |
| ▲ | mememememememo 3 hours ago | parent [-] | | Or just make sure you git fetch repos into $other-place. That helps with Git not so much issues etc. | | |
| ▲ | corvad 3 hours ago | parent [-] | | Yeah, I think especially Git mirrors can go a long too for maintaining availability and also for reducing load off main infra. |
|
|
|
| ▲ | sc__ 3 hours ago | parent | prev | next [-] |
| Microslop |
|
| ▲ | MattIPv4 4 hours ago | parent | prev | next [-] |
| Hitting 500s when trying to push branches and create PRs. |
|
| ▲ | tholford 2 hours ago | parent | prev | next [-] |
| Setting up a Gitea instance is approachable, especially with agent assistance. https://about.gitea.com/ |
|
| ▲ | steeleduncan 3 hours ago | parent | prev | next [-] |
| What has changed at GitHub to cause this? |
| |
| ▲ | smartmic 3 hours ago | parent | next [-] | | AIpocalypse. Eaten too much Copilot dog food. | | |
| ▲ | bartread 3 hours ago | parent | next [-] | | Perhaps even AIslopalypse. | | |
| ▲ | KaiserPro 2 hours ago | parent | next [-] | | Looking at the status, its not one long outage, but lots of little ones, microslops if you will. | |
| ▲ | zahlman 2 hours ago | parent | prev [-] | | I've been using "slopocalypse". People already know AI is responsible, but slop existed before — e.g. conventionally generated SEO spam. It's just... so much worse now. | | |
| ▲ | bartread 2 hours ago | parent [-] | | "Slopocalypse": yeah, I like that. Easier to pronounce too. At any rate, it seems like GitHub is back up now, so we'll see how long that lasts. |
|
| |
| ▲ | adzm 2 hours ago | parent | prev [-] | | Weird Al needs to capitalize on this whole AI/Al thing |
| |
| ▲ | pixelesque 3 hours ago | parent | prev | next [-] | | Possibly a combination of moving infrastructure to Azure, and also a significant increase in the number of PRs and commits due to Vibe-coding? | | | |
| ▲ | pera 2 hours ago | parent | prev | next [-] | | Microsoft Makes AI Mandatory For Employees https://www.forbes.com/sites/bernardmarr/2025/07/08/microsof... | |
| ▲ | voidfunc 3 hours ago | parent | prev | next [-] | | Azure | | |
| ▲ | altairprime 3 hours ago | parent [-] | | > Azure To explain this one-word comment for those unfamiliar, see previously: GitHub will prioritize migrating to Azure over feature development (5 months ago) https://news.ycombinator.com/item?id=45517173 In particular: > GitHub has recently seen more outages, in part because its central data center in Virginia is indeed resource-constrained and running into scaling issues. AI agents are part of the problem here. But it’s our understanding that some GitHub employees are concerned about this migration because GitHub’s MySQL clusters, which form the backbone of the service and run on bare metal servers, won’t easily make the move to Azure and lead to even more outages going forward. | | |
| ▲ | 0xbadcafebee 32 minutes ago | parent [-] | | Age-old lesson: change the tires on the moving vehicle that is your business when it's a Geo Metro, not when it's a freight train. I'm sure the people with the purse strings didn't care, though, and just wanted to funnel the GH userbase into Azure until the wheels fell off, then write off the BU. Bought for $7.5B, it used to make $250M, but now makes $2B, so they could offload it make a profit. I wonder who'll buy it. Prob Google, Amazon, IBM, Oracle, or a hedge fund. They could choose not to sell it, but it'll end up a writeoff if the userbase jumps ship. |
|
| |
| ▲ | yoyohello13 3 hours ago | parent | prev | next [-] | | Vibe coding features. | |
| ▲ | staticassertion 3 hours ago | parent | prev | next [-] | | I assume this is all of the pains of going from "GHA is sorta kinda on Azure", which was a bad state, to "GHA is going full Azure", which is a painful state to get to but presumably simplifies things. | | | |
| ▲ | qudat 3 hours ago | parent | prev | next [-] | | Their primary goal in the last year was to move to Azure. Any massive infra migration is going to cause issues. | | |
| ▲ | seneca 3 hours ago | parent [-] | | > Any massive infra migration is going to cause issues. What? No, no it's not. The entire discipline of Infrastructure and Systems engineering are dedicated to doing these sorts of things. There are well-worn paths to making stable changes. I've done a dozen massive infrastructure migrations, some at companies bigger than Github, and I've never once come close to this sort of instability. This is a botched infrastructure migration, onto a frankly inferior platform, not something that just happens to everyone. |
| |
| ▲ | the_real_cher 3 hours ago | parent | prev | next [-] | | A.I. but that acronym can mean a number of things. Artificial intelligence, Azure integration, many other things. | |
| ▲ | paxys 3 hours ago | parent | prev [-] | | Senior engineers/leaders getting tired of Microsoft's shit and leaving. |
|
|
| ▲ | rileymichael 3 hours ago | parent | prev | next [-] |
| looking forward to the `addressing-githubs-recent-availability-issues-3` news post |
|
| ▲ | overgard 3 hours ago | parent | prev | next [-] |
| I remember back in the early Windows XP era when things got so bad that Microsoft basically had to make a hard pivot towards security and reliability. I think they may need to do that once again. Almost every product of theirs feels like a dumpster fire. GitHub is down constantly, Windows 11 is a nightmare and instead of patching things they're adding stupid features nobody asked for. I think they need to stop and really look closely at what they're prioritizing. |
|
| ▲ | wenbin 2 hours ago | parent | prev | next [-] |
| I guess vibe coding can't solve such problem for now... |
|
| ▲ | ekropotin 3 hours ago | parent | prev | next [-] |
| Remember when GitHub was cool? Pepperidge Farm remembers. |
| |
| ▲ | whalesalad 3 hours ago | parent [-] | | I remember. My GitHub user ID is #5907, account created 2008-04-08T20:27:36Z. I think it is inevitable that all good things come to an end, but it's still a bummer to see. | | |
|
|
| ▲ | pylua 3 hours ago | parent | prev | next [-] |
| Anyone else notice other Microsoft cloud services ( for instance inside azure ) with bad performance also? I can’t be specific but we are constantly complaining. |
| |
| ▲ | sysworld 3 hours ago | parent | next [-] | | The Azure management UI, yes, so slowww. But the services (VMs etc) have been good. | |
| ▲ | keithnz 3 hours ago | parent | prev [-] | | No? Azures been rock solid for us. | | |
|
|
| ▲ | butterlesstoast an hour ago | parent | prev | next [-] |
| That Go rewrite continues to rear its head, eh? |
|
| ▲ | justinholmes 2 hours ago | parent | prev | next [-] |
| Moved to self hosted crowci instead of actions. |
|
| ▲ | TimReynolds 2 hours ago | parent | prev | next [-] |
| Would be easier for them to just tell us when it’s up these days |
|
| ▲ | s_u_d_o 2 hours ago | parent | prev | next [-] |
| Can this downtime be quantified to actual monetary losses? |
|
| ▲ | packetlost 3 hours ago | parent | prev | next [-] |
| I've been sitting here waiting for a critical deploy to happen via GitHub Actions (I know, hour fault, we should have left ages ago). My patience for this bullshit is gone, I'm going to be pushing very hard to get us off of GitHub entirely except for public code mirrors going forward. Edit: oh look, their site says all good, but I still have jobs stuck. What a pile of garbage. I'm so sick of this. |
|
| ▲ | nasretdinov 3 hours ago | parent | prev | next [-] |
| Must be Tuesday then |
|
| ▲ | newbish 2 hours ago | parent | prev | next [-] |
| So am I the only one thinking that maybe GitHub is succumbing to the weight of AI slop that's coming in from all the vibecoding, clawbots, and other AI workflows? |
|
| ▲ | lousken an hour ago | parent | prev | next [-] |
| Github CEO must be on HN, right? If so, any comments? They have not even bothered to implement entra login when they have their competitors login for years, do they even know what their product is? Or are you just a middle man for slop? |
|
| ▲ | esafak 3 hours ago | parent | prev | next [-] |
| Microsoft products are so human, they stop working weekly as if they're observing some sort of sabbath ... |
|
| ▲ | cyanydeez 2 hours ago | parent | prev | next [-] |
| That's just like your Vibe man; can you just copilot your wayout of these problems? |
|
| ▲ | ransom1538 3 hours ago | parent | prev | next [-] |
| Did MS finish the Hotmail transition? |
|
| ▲ | pbkompasz 3 hours ago | parent | prev | next [-] |
| Vibe check? |
|
| ▲ | duped 3 hours ago | parent | prev | next [-] |
| Does github not do any kind of blue/green rollouts or what |
|
| ▲ | GiorgioG 3 hours ago | parent | prev | next [-] |
| I'm going to blame Claude Code! |
|
| ▲ | rdedev 3 hours ago | parent | prev | next [-] |
| My vscode slop session stopped in between. Maybe it's for the better |
| |
|
| ▲ | olivia-banks 3 hours ago | parent | prev | next [-] |
| At least it happened after I did my work for the day... jfc! |
|
| ▲ | messe 2 hours ago | parent | prev | next [-] |
| For fucks sake. I've been considering it for a while, but I'm definitely now pitching a move away from GitHub at our organization. |
|
| ▲ | jbmilgrom 2 hours ago | parent | prev | next [-] |
| h8 github so much. ahhhhhh |
|
| ▲ | Imustaskforhelp 3 hours ago | parent | prev | next [-] |
| You have GOT to be kidding me. |
| |
|
| ▲ | rvz 3 hours ago | parent | prev | next [-] |
| GitHub goes down at least once a week as I said before. [0] thanks to Copilot, Tay.ai and Zoe chatbots wrecking the platform instead of humans maintaining it. If there was a prediction market for when GitHub experiences an outage every week, then you would make a lot of money. [0] https://news.ycombinator.com/item?id=47487881 |
| |
| ▲ | serf 3 hours ago | parent | next [-] | | >GitHub goes down at least once a week as I said before. [0] thanks to Copilot, Tay.ai and Zoe chatbots wrecking the platform instead of humans. there are tens of thousands of stupid scripts hosted on github itself that have scheduled progmatic pushes or pulls to repos via cron jobs with millions and millions of users -- yeah LLMs accelerate the fire but let's not pretend that GH was some bastion of real-user-dom somehow at some point. | |
| ▲ | pak9rabid 3 hours ago | parent | prev [-] | | Vegas should start taking bets |
|
|
| ▲ | bartread 3 hours ago | parent | prev | next [-] |
| Fuck sake. Again? Sorry, I realise this comment isn't up to HN's usual standards for thoughtfulness and it is perhaps a bit inflammatory but... look, I'd bet the majority of us on this site rely on GitHub and I can't be the only one becoming incredibly frustrated with its recent unreliability[0]? (And, yes, I did enough basic data analysis to confirm that it IS indeed getting worse versus a year, two years, and three years ago, and is particularly bad since the start of this year.) [0] EDIT: clearly not from looking at the rest of the comments in this discussion. |
| |
| ▲ | zahlman 2 hours ago | parent [-] | | > I realise this comment isn't up to HN's usual standards for thoughtfulness > And, yes, I did enough basic data analysis to confirm Perhaps you'd consider showing us that analysis? That sounds like it would make a pretty substantive, thoughtful comment. | | |
| ▲ | KaiserPro 2 hours ago | parent | next [-] | | > consider showing us Gaze upon the tapestry in which github paints it's failure with a thin copper red thread: https://www.githubstatus.com/ | |
| ▲ | bartread 2 hours ago | parent | prev [-] | | @KaiserPro has pasted the link to someone else's heatmap, which is really good. Mine was just an Excel spreadsheet with a graph that I'd intended to write a blog about but then got demotivated on because I was too busy with other things and I saw that heatmap as well. Maybe I will do a proper write up next time GitHub has an outage and I'm blocked by it. |
|
|
|
| ▲ | nomilk 35 minutes ago | parent | prev [-] |
| Why don't companies with chronic outages mimic their stack from top to bottom (i.e. starting with a new domain), then before making a change, make the change on the duplicate stack and blast it with mock requests. Might catch 90% of problems before they make it into the real stack? E.g. every step of GitHub's migration to Azure could be mimicked on the duplicate stack before it's implemented on the primary stack. Is this just considered too much work? (I doubt cost would be the issue, because even if it costs millions, it would pay for itself in reduced reputational damage from outages). |