Remix.run Logo
beardedetim 3 hours ago

We're starting to have the conversation of "do we need to replace GitHub as our CI/CD pipeline?"

No idea if/when we decide to pull that bandaid but I think once we can't merge a hot fix into main because of GH being down, it'll be a big org push to replace it.

What's everyone else using? Self hosted Gitlab? Gitea?

elric 3 hours ago | parent | next [-]

> We're starting to have the conversation of "do we need to replace GitHub as our CI/CD pipeline?"

Did you have the conversation "do we need to move from $whatever CI/CD to GitHub Actions?" beforehand? What were the arguments in favour?

Macha 2 hours ago | parent | next [-]

Not the same company but similar discussions here:

- It was believed that GitHub would be more reliable than our self hosted Gitlab CI runners. This has proven to be very false.

- It was believed it would be easier to write tooling. I’m not on the dev tooling team, so can’t confirm if they found it true or not, but from the outside I see a lot more “Github can’t do that” than I did “Gitlab can’t do it”

Normal_gaussian 2 hours ago | parent [-]

Those are both hilarious to me. In my last FTE role we had the exact opposite beliefs - we wanted to leave GitLabs increases in pricing and move to annual sub, but the reliability of self-hosted runners and the flexibility (and clarity) of the CI system was fantastic.

dataengineer56 2 hours ago | parent [-]

> Those are both hilarious to me.

Why is it hilarious to believe that the industry leader might be better at something than doing it yourself?

Normal_gaussian an hour ago | parent | next [-]

The hilarious part is more the absurdity and cognitive disconnect experienced when reading about serious evaluations that went in a completely opposite direction to those directly participated in.

2 hours ago | parent | prev [-]
[deleted]
beardedetim 2 hours ago | parent | prev [-]

It's a ~year old product that started on GH. So this is the first time this team has had to think through "okay, so this isn't as reliable as it was at $oldjob."

layer8 2 hours ago | parent | prev | next [-]

Self-hosted GitLab at work, self-hosted Gitea at home.

lsuresh 3 hours ago | parent | prev | next [-]

We use self-hosted Github runners, but it's a moot point if all of Github is mostly down as is the case right now. :\

stephenway 2 hours ago | parent | prev | next [-]

If you're seriously looking at Gitea/Forgejo, I run Fjord, dedicated managed Forgejo, so you don't have to operate it yourself. We can help with migration and runners too. We also run a free public Forgejo instance if you just want to kick the tires first.

mitchjj 2 hours ago | parent | prev | next [-]

Worth being upfront with, I'm an employee, but; Buildkite.

Frontier labs and global saas heavyweights run CI through us, plus a crop of open source tooling like Bazel, vLLM, Firecracker, Rails, Ray, Sorbet and Rust.

Shopify, Uber, Airbnb, Canva stresstested the platform ten years ago for scaling issues.

You need to take a little time to design upfront and take advantage of dynamically programmable primitives. It isn't the same ease/convenience as Actions. Bit more available though.

tom1337 an hour ago | parent [-]

How would I be able to run my CI via Buildkite when I still host in GitHub and their API is down? We are currently already using self-hosted runners and they also don't work because either they aren't started by GitHub or can't download the code.

nerdypepper an hour ago | parent | prev | next [-]

ultimately, folks need to stop writing massive YAML files to define their builds. CI should schedule jobs, your build system should define them. my workflow files look like this:

      steps:
          name: Do the thing
           run: nix build .#
at any point, if my CI is down or i need to switch or i need to run builds locally, i can do so trivially.
Norfair an hour ago | parent [-]

NixCI does this but with a built-in cache ;) https://nix-ci.com/comparison/github-actions

qweqwe14 3 hours ago | parent | prev | next [-]

Self-hosted GitLab and self-hosted GitLab Runners (Omnibus Docker image)

nerdypepper 3 hours ago | parent | prev | next [-]

> What's everyone else using? Self hosted Gitlab? Gitea?

tangled.org!

http-teapot 2 hours ago | parent | next [-]

What's your experience with tangled? Would love to hear the experience from other users as well

MarkBennett an hour ago | parent [-]

It's worked great for hosting my smaller personal projects so far, and I've already received a few helpful pull requests from the community.

Tangled.org really been working to ensure all their features work from data hosted on your personal data server (it's based on ATproto) which means should their performance, reliability, or monetization ever get you down it's easy to switch to a competitor since you're not locked in.

classified 3 hours ago | parent | prev [-]

I'm completely untangled. From GitHub.

drno123 3 hours ago | parent | prev | next [-]

Self hosted Gitea

newswasboring 3 hours ago | parent [-]

When you self host, what happens with your compute costs? CI can be super expensive depending upon your test pipeline. Do you end up spending more than you would with GitHub actions for example?

JoshStrobl 2 hours ago | parent | next [-]

Just get some x86 and ARM runners off netcup, manage Woodpecker CI + Woodpecker Agent. Generally pretty hands-off once you get it set up. That plus a cheap VPS running Forgejo with postgres off-site backups, you are looking at a small fraction of the cost compared to per-seat GitHub pricing for orgs + Action Minutes.

Maxion 3 hours ago | parent | prev [-]

Huh? The VPS boxes have a fixed monthly fee

applidhumanco 2 hours ago | parent [-]

He is likely referring to the CI runners. Gitea has their own version of Actions runner. It is very much usable, though currently inferior to GitHub Actions (not always a 1:1 replacement, even though they aim for it to be): https://docs.gitea.com/usage/actions/

Cost as always depends on your usage, but it will likely be less than your current cost of GitHub Actions.

speleding 2 hours ago | parent | prev | next [-]

If your app is not too large you can do CI/CD perfectly fine from your laptop. Put it in a docker container if you want to ensure it is perfectly reproducible. You still need Github as the origin repo to pull from, but the "git part" of GitHub seems to be (almost) always up and running. (We use "capistrano" for this)

cesarb 2 hours ago | parent [-]

> If your app is not too large you can do CI/CD perfectly fine from your laptop.

Not if you want to make sure it compiles and works on Windows (which you don't have) or macOS (which you don't have and can't emulate). That's something github gives for free, and for me, it's the only reason to stay on github for small/tiny free software projects (at least as a secondary host).

dcan 2 hours ago | parent | prev | next [-]

Self hosted Gitlab at work with local runners

latchkey 2 hours ago | parent | prev | next [-]

blacksmith.sh just raised tens of millions on the core premise that self-hosting CI/CD is hard [0].

they've had multiple outages in the last week, so i guess they are proving themselves correct.

in practice, giving ssh/sudo to AI (codex) and telling it to setup ephemeral self-hosted runners on your own host VM (qemu), takes about 30 minutes and works extremely well. it bangs out all the shell scripts. moved my own business over to it. zero problems.

you might even find it is kind of neat too. you can customize your VM with software pre-installed. speeds up your builds quite a bit.

[0] https://www.blacksmith.sh/blog/blacksmith-seed-announcement

mitchjj 2 hours ago | parent [-]

They run on top of GH, so if GH goes down, so does Blacksmith, every time

latchkey an hour ago | parent [-]

the recent outages were with their own storage infrastructure

https://status.blacksmith.sh/cmsrg61yg09vd0lo9s1eagibm

badgersnake 2 hours ago | parent | prev | next [-]

TeamCity

c2403 3 hours ago | parent | prev [-]

Have you considered Codeberg?

sscaryterry 2 hours ago | parent [-]

Different set of ideologies completely, not an alternative.

6031769 2 hours ago | parent [-]

An alternative set of ideologies is part of what makes it ... an alternative!

I mean, that plus better uptime.

sscaryterry 2 hours ago | parent | next [-]

Its about freedom, which codeberg are supposed to be proponents of. Turns out, they're no better than github :)

See: https://blog.codeberg.org/protecting-our-floss-commons-from-...

Macha 2 hours ago | parent | prev [-]

I remember in 2024 passing over codeberg as the host for some of my personal projects because of the uptime. I don’t think Codeberg’s uptime has gotten any better but despite that it’s getting a lead over GitHub now.