They can refuse, and they have refused. See San Bernardino and the concept of "compelled work".