How easy is it to set up and run this for private repos?

It looks like it has so many cool features -- stacked PRs, jujutsu support, CI in Nix VMs. But I've never tried it because it sounds like (at least by default) it's some sort of decentralized, peer-to-peer public thing

Yeah, only open for public repositories until Atproto finishes their permissioned data spec.