I don't particularly think so. What matters is whether the stuff in the book was true, not whether the author is of unassailable character

When one's goal is to look for any reason to downplay facts, questioning the character of the messenger is a standard tactic.