> I am just not sure what it measures.

All of the above, to the extent that they can be measured from a simple to verify end condition (stats, win rates, etc). Adaptability, ability to understand and progress on a task, and so on.

▲

iugtmkbdfil834 an hour ago | parent [-]

Yes, but I guess my objection is that if it attempts to measure everything then we can't really tell what it measures in what proportions.

▲

robotresearcher an hour ago | parent [-]

Yep, that’s a feature of end to end measures, like company revenues, vehicle fuel efficiency, or human life expectancy.

The customer may not care what the internal contributions are to such a measure. Instead it represents the customers’ overall values in some way.

	▲	iugtmkbdfil834 an hour ago \| parent [-]
		Ok. I think you convinced me based on those. I withdraw the objection.