You wont loose only the good people. You will loose the usual mix. Plenty of slackers or not good people are fully capable to make their way through interviews. That is how they got here, after all.

It is always just pure wishful thinking that "all the people you will loose when you alienate someone like me" are totally the best people out there.