But why man of science would avoid starting crusades?

Moral virtue has nothing to do with being a man of science, and many men of science lacked it completely.

Exactly. We tend to forget that the crusades were an efficient way of assigning land (scarce) to the cadet branches of ruling families (abundant), or die trying.