But if no other crate depends on your crate and nobody directly uses it, why would any CI system download it?

I think some of the CI systems just monitor all published crates. For example, docs.io potentially pulls it to see if there is any new documentation