Interesting the use of Max and Ultra. I don’t doubt the complexity, but would someone use Max or Ultra on Typescript or Go, for example?

Is it more about just avoiding any mistakes? Seems like that would be costly when medium or high would work fine?

*The "Max" I referred to was the plan tier, not the effort level btw

For small tasks, you can just use something like low or medium effort and it can usually avoid mistakes; after all, the model will test the code anyways and can do some baseline level of iterating.

In regards to cost, we need to acknowledge how generous OpenAI was in the last couple months with Codex usage credits (no weekly limits) and usage resets. It afforded me many a dive with Codex! Yes it uses more tokens, but sometimes it's worth it -- just depends on what you're working on.

Finally, Ultra(code) isn't that bad when it comes to cached tokens. I think folks overstate the general token usage of ultra effort on both providers.

---

Both models are great at green-fielding a project when given detailed specs.

Both models overthink too liberally (imo) during these larger multi-shots. Sol overthinks more than Fable.

Both models are really smart and perform great for general knowledge and regular coding tasks.