When a system gets "overloaded", typically it enters exponential degradation of performance state, i.e. performs self ddos.

> Seeing them get 96% improvements is insane

TFA is talking about P99 tail latencies. It does not sound too insane to reduce tail latencies by extraordinary margins. Remember, it's just reshaping of latency distribution. In this case pathological cases get dropped.