Then you're engaging in the black and white thinking fallacy.