It would make the benchmark way better obviously, by showing how their new model compares to their competitors, the whole point of benchmarks and graphs.

The point of Cursor Bench is to show how models perform in Cursor. If 99% of their users won't be able to access a model unless they go out of their way to include setup an API key for it (which would be insanely expensive with Astra), why would they include it in the benchmark?