| ▲ | elAhmo 2 hours ago | |
> Use shorter prompts: In internal evaluations, replacing long, explicit system prompts with minimal prompts improved scores by roughly 10–15%, while reducing total tokens by 41–66% and cost by 33–67%. A shorter prompt results in half as much tokens spend? I find this very hard to believe. | ||
| ▲ | bulder 2 hours ago | parent | next [-] | |
If it's anywhere close to the same universe as smaller models in its behavior, a lot of time in "thinking" mode is spent on reiterating on any constraints given in a prompt. So the more constraints you give it, the more tokens it will spend going "Hold on, the prompt said I have to dot my i's and cross my t's. Let me go through my work to check that all the i's are dotted." | ||
| ▲ | zeven7 2 hours ago | parent | prev [-] | |
Maybe Codex has the same problem I sometimes have focusing while reading and has to reread the same sentence over and over again. | ||