| ▲ | Starlevel004 6 hours ago | |
That terminal bench 4.0 result is... bad? Terra XHigh more expensive than Sol Low and still does worse. It's very likely this is a next checkpoint of GPT-6 "Sol", over-optimised for the web chat and offered to Codex subscribers as a "please go away" offering. If this was half the price, I'd be very interested, but at 1/5/0.05? Feels like another panic release because they can't get Astra 6.1 out of the door... | ||
| ▲ | rockdoe 2 hours ago | parent [-] | |
Scoring "bad" on Terminal Bench 4.0 can also be a sign that it's cheating less: https://preferencemodel.com/blog/terminal-bench-4-is-saturat... | ||