Remix.run Logo
elAhmo 2 hours ago

> Use shorter prompts: In internal evaluations, replacing long, explicit system prompts with minimal prompts improved scores by roughly 10–15%, while reducing total tokens by 41–66% and cost by 33–67%.

A shorter prompt results in half as much tokens spend? I find this very hard to believe.

bulder 2 hours ago | parent | next [-]

If it's anywhere close to the same universe as smaller models in its behavior, a lot of time in "thinking" mode is spent on reiterating on any constraints given in a prompt. So the more constraints you give it, the more tokens it will spend going "Hold on, the prompt said I have to dot my i's and cross my t's. Let me go through my work to check that all the i's are dotted."

zeven7 2 hours ago | parent | prev [-]

Maybe Codex has the same problem I sometimes have focusing while reading and has to reread the same sentence over and over again.