I don't know what basis these numbers are estimated on, but my M2 Ultra 128GB runs almost twice as fast as what's reported for the M3 Ultra 512GB.

I wished there was such a tool before picking my hardware, it's useful. But the estimates needs to be somewhat correct.

Thank you for the feedback. What model/quant did you test so I can look in it?