Remix.run Logo
nicholast 2 days ago

Part of the problem of this form of benchmarking is that in some domains we wouldn't only be interested in the percent of times that an error channel is successfully mitigated, we would also be interested in the distribution of types of errors for cases where an error channel isn't successfully mitigated. The paper appears to be silent on that matter.