I suspect AI crawler would also (quickly learn to) respect it also?
In that case, mission accomplished.