That's not accurate. OpenAI doesn't allow Grok to provide Astra to Cursor customers anymore, but it doesn't ban anyone from using Astra via alternative harnesses.

If Cursor wanted to include Astra in CursorBench nothing would stop them, they could easily have spent half an hour vibecoding in OpenAI API key support - if it hadn't been convenient to neglect to do that.

▲

andsoitis 6 hours ago | parent | next [-]

Even if they could do that (workaround to include Astra in CursorBench), that has no practical consequences for Cursor users and that's what I as a Cursor user (what I use for dev, though I use ChatGPT for non-dev stuff) care about.

▲

kristofferR 6 hours ago | parent [-]

It would make the benchmark way better obviously, by showing how their new model compares to their competitors, the whole point of benchmarks and graphs.

	▲	Jcampuzano2 6 hours ago \| parent [-]
		The point of Cursor Bench is to show how models perform in Cursor. If 99% of their users won't be able to access a model unless they go out of their way to include setup an API key for it (which would be insanely expensive with Astra), why would they include it in the benchmark?

▲

mh- 3 hours ago | parent | prev [-]

If the benchmark is "what's the best model to use in your Cursor subscription", why would they do that? OpenAI knew what the effects of their decision were. Hard for me to have sympathy for either party here, honestly, and I say that as someone who is a customer of both.