Feels like if any bot doesn't respect it, then inevitably the data ends up in every bot's training data.

Same thing unfairly killed "Do Not Track". Thanks Microsoft

(yes I realize that was more about ad companies refusing to accept it as an "opt-in", but only as an "opt-out")