▲ | SV_BubbleTime 4 days ago | |||||||||||||||||||||||||
There is so much subjective placebo with “prompt engineering” that anyone pushing any one thing like this just shows me they haven’t used it enough yet. No offense, just seeing it everywhere. Better results if you… tip the AI, offer it physical touch, you need to say the words “go slow and take a deep breath first”… It’s a subjective system without control testing. Humans are definitely going to apply religion, dogma, and ritual to it. | ||||||||||||||||||||||||||
▲ | cdrini 4 days ago | parent | next [-] | |||||||||||||||||||||||||
The best research I've seen on this is: - Threatening or tipping a model generally has no significant effect on benchmark performance. - Prompt variations can significantly affect performance on a per-question level. However, it is hard to know in advance whether a particular prompting approach will help or harm the LLM's ability to answer any particular question. | ||||||||||||||||||||||||||
| ||||||||||||||||||||||||||
▲ | diggan 4 days ago | parent | prev | next [-] | |||||||||||||||||||||||||
> Better results if you… tip the AI, offer it physical touch, you need to say the words “go slow and take a deep breath first”… I'm not saying I've proven it or anything, but it doesn't sound far-fetched that a thing that generates new text based on previous text, would be affected by the previous text, even minor details like using ALL CAPS or just lowercase, since those are different tokens for the LLM. I've noticed the same thing with what exact words you use. State a problem as a lay/random person, using none of the domain words for things, and you get a worse response compared to if you used industry jargon. It kind of makes sense to me considering how they work internally, but happy to be proven otherwise if you're sitting on evidence either way :) | ||||||||||||||||||||||||||
| ||||||||||||||||||||||||||
▲ | kachapopopow 4 days ago | parent | prev | next [-] | |||||||||||||||||||||||||
I tell my agent to off it self every couple of hours, it's definitely placebo as you're just introducing noise which might or might not be good. Adding hmm, <prompt> has been my goto for a bit if I want it to force to give me different results cause it appears to trigger some latent regions of the llms. | ||||||||||||||||||||||||||
| ||||||||||||||||||||||||||
▲ | throwawa14223 4 days ago | parent | prev [-] | |||||||||||||||||||||||||
This is one of many reasons that I believe the value of current AI tech is zero if not negative. |