I've been looking to build something similar to this so this is very timely!

What I wanted to build is a way for Claude Code to automatically receive reviews and CP failures from a Github PR and automatically revise code and respond to comments. It looks like with a custom Github PR channel I can get very close to this, although I do wish that a channel can be opened in a running session instead of having to create a new one. Hopefully they add that soon.

I did this for Forgejo, now adding Gitlab and planning Github as well: https://github.com/smithy-ai/smithy-ai

It runs Claude in docker containers, listens for webhooks to see comments and CI status.