Ah no I hadn't seen that, very interesting.

I'm finding a gap just before running those experiments.

The process of updating firmware, doing basic smoke tests on each device and validating it is live, and can function correctly.

Basically the pre-deployment green light that you get on github, but for hardware.

Have you seen or thought about that at all?

This seems indeed useful. I haven't seen this for robotics but I'm sure people need this for larger deployments (either for a distributed fleet or for an "arm farm"-like setup where there's many robots in one location for data collection / eval). Interesting idea!