Remix.run Logo
dclowd9901 5 hours ago

I'm always confused by these phrases:

> The new API cuts word error rate by 3.5 to 4x on the same audio: from 9.02% to 2.12% on clean speech

Shouldn't they have said "cuts error rate by 78%" or something?

clickety_clack 5 hours ago | parent [-]

I don’t like it written that way either, and it always seems like the type of number you put on a slide for a head of sales or something. It rankles because:

- it implies that error could be increased n-times, but a 15x _increase_ in 9% error would be an error rate of 135%, which is nonsensical.

- a reduction from 90% error to 20% error is clearly a bigger improvement in rightness to a reduction from 9% to 2%. One is “almost all wrong to almost all right”, the other is “more right”, but they are both a 4.5x reduction in error which means that the 4.5 quantity doesn’t have a constant meaning.

The answer is something like log odds ratios, but that introduces the additional need for a reader to know what that is, and that would be unusual.