| ▲ | IgorPartola a day ago | |||||||
Full instruction following looks like monkey’s paw/malicious compliance. A good way to eliminate a bug from a codebase is to delete the codebase, that type of thing. You want the model to have enough creative freedom to solve the problem otherwise you are just coding using an imprecise language spec. I know what you mean: a lot of my prompts include “never use em-dashes” but all models forget this sooner or later. But in other circumstances I do want it to push back on something I am asking. “I can implement what you are asking but I just want to confirm that you are ok with this feature introducing an SQL injection attack into this API endpoint” | ||||||||
| ▲ | stingraycharles a day ago | parent [-] | |||||||
My point is that it’s better that the model asks questions to better understand what’s going on before pushing back. | ||||||||
| ||||||||