Remix.run Logo
mchusma 2 hours ago

Looks like a great set of models, but there are about 20 different thinking/model levels here in this family and they are very complex to pick the right one for the task

E.g. for GeneBench Pro, it looks like you would always use GPT-5.6 Sol over Terra/Luna, its pareto optimal.

For Agents Last Exam, you would maybe want Luna, then Terra, then Luna, then Sol as you increasingly budget for tasks.

I feel that there may need to be a new auto mode in many of these cases. It selects the best model and thinking given a particular problem.

Feels like it's going to have to go that way eventually, because here we have about 20 different model and thinking levels you could use, and they're not obvious which ones are right for the given use case.