You'd think they would have dashboards for all of this stuff, to easily notice any change in metrics and be able to track down which release was responsible for it.

They probably do, then they pipe it into a bunch of Claude subagents and then you get the current mess.