If everyone does it, then it becomes less effective, because there'd be fewer early testers to experience and report issues, no?

Yes, it's gonna be heuristics all way down. This problem isn't solved formally but the ecosystem(s) having these issues are too big to be discarded "just" because of that.