Run your own evals then if you have this much of a need to "correctly" choose. That'll make it clear.

I'll just stick to mostly Sol on low/medium/high and start experimenting with Terra tomorrow onward to see what it does noticeably better than Luna/Deepseek flash.

Any pareto frontier model, especially from the leading labs is guarnateed to be good enough for whatever your expectations are at this point. A quick few day test should be enough for anyone to make their own conclusions.

Right, having products so poorly described that a customer needs to run their own evals to choose well is exactly what is being complained about.

Or I'm going to give up and not use any. Consumers aren't perfectly rational. This isn't like toothpaste, where, despite being overwhelmed at the store, I still need to brush my teeth so ahhhhhh fuckit and just pick a toothpaste out of the 30 available. The alternative is I keep using Google search and think AI is stupid. Or just use Facebook's thing.

> > But does Terra 6.1 beat Sol 6?

> Run your own evals then if you have this much of a need to "correctly" choose.

No. OpenAI want my money, it's on them to communicate properly.