| ▲ | epihelix 2 hours ago | |
> Use shorter prompts: In internal evaluations, replacing long, explicit system prompts with minimal prompts improved scores by roughly 10–15%, while reducing total tokens by 41–66% and cost by 33–67%. When has this ever not been the case? I don't think this is a GPT 5.6 specialty! | ||
| ▲ | adam_arthur 2 hours ago | parent | next [-] | |
Information density of the prompt is the most important factor in my experience. And interestingly, LLMs seem particularly bad at writing prompts for other LLMs for this reason (you can guide them to be more dense, just speaking by default). Conciseness is usually a byproduct of information density though. | ||
| ▲ | daemonologist an hour ago | parent | prev | next [-] | |
There was a fad a while back of building insanely long prompts - tens of thousands of tokens - including having models write prompts for themselves. I always thought it was counterproductive, especially if you're going to use the prompt more than a couple of times. (That said, the e.g. Claude Code system prompt is insanely long, so if you genuinely have a lot of information to provide maybe it's beneficial. Like, shorter is better, but you don't want to be under-specified.) | ||
| ▲ | CuriouslyC an hour ago | parent | prev [-] | |
For Gemini 2.5 and ~GPT5.0-5.1, longer prompts with lots of explicit instructions and examples produced better conformance. Seems like heavily second guessing the models started to get counter productive around the end of last year. | ||