It updates the existing PR with the tests, I believe. They'd still get reviewed and go through CI.
Right, the downside being that the app needs write access to your repository.
Writing to PR branches should really be some new kind of permission.