It can open GitHub PRs from the interface and there's tons more info we want to pull in like the result of CI checks

Then you should have gone with a GitHub App instead of an Oauth App. The difference is that a GitHub App allows granularity of selection.