Remix.run Logo
▲ fy20 2 hours ago

Yes but you are missing the point. It's the case where Luna is not good enough, and Sol is too much. The problem is that on benchmarks Luna xhigh is typically comparable to Sol low in terms of capability. So where does Terra fit in?

▲dannyw 39 minutes ago | parent [-]

World knowledge, factual recall without grounding, more complex instruction following, etc.

Benchmarks don’t really tell you much. For API best will always be a model+effort sweep on your internal evals (and if you don’t have internal evals, do that first).

For individual coding harnesses, honestly I just go with vibes. The best workflow is the one that works for you.