Attack the source as much as you like, it's not refuting the point in any way.

Isn't the validity and credibility of the source critical to it being supportive of your argument? Seems like a reasonable counter-argument in my opinion.