| ▲ | OKRainbowKid 13 hours ago | |
So are you saying that effort level isn't a parameter to an LLM, but that each level actually corresponds to a slightly differently tuned LLM? | ||
| ▲ | bossyTeacher 9 hours ago | parent [-] | |
I think the analogy here is time. Especifically performance time. Head chef performs slower. High effort is longer inference time. For LLMs, the ability to think in more detail requires more time. Maybe this will change in the future but it is the present now. | ||