Why would we defend the rights of someone that refuses to defend ours?

Because "their" rights and "our" rights (whoever "us" and "them" happen to be) are one and the same. You wouldn't be defending or attacking "their" rights, you'd be defending or attacking rights in general, and that includes yours.