Maybe some type of reputation system could help. ie: "karma" but for github. Increases whenever you make good contributions that get merged, decreased if you submit slop that gets rejected.