You can also define "days" and "years" in terms of that SI definition.

I don't think that helps with the original concern.

You can, yes. But having it all stem from some fundamental constant value any civilization can handle permits translation between civilizations.

"Our dates start x trillion rotations of pulsar y ago and our unit is defined as z wiggles of cesium" is a starting point.