You can restrict PRs only to 'collaborators' of your repository, or you can disable them completely.