So do an infinite number of sets of statements which include a false one. Circular arguments are obviously not reliable.

That's a hypothesis of a counterexample, though, not a fact of a counterexample.