Honestly, I wish that LLMs were better at challenging their own assumptions, or even just stating them for me to validate before rushing ahead. By far the biggest aggregate waste of time for me with them is how they all seem to be tuned to try to guess what I'm going to want next and give it to me in advance, when in reality what I want is very commonly dependent on what I get back from the current thing. Sometimes I swear they must have been explicitly trained to treat as many questions as possible as rhetorical rather than literal, because they love to interpret my genuine inquiries as implicit commands instead.

I know that communicating indirectly is pretty common for people, but there are two glaring issues with that for me when it comes to these tools: being on the spectrum makes it way more difficult for me to anticipate when what I'm saying is the type of thing that another human would likely not take literally, and more importantly, I'm not talking to another human, so the social incentives that lead to indirect communication (politeness, fear of social repercussions, etc.) don't exist at all for LLM interactions.

▲

jaggederest 7 hours ago | parent [-]

Yep! I also find that pretty frustrating, it's like, I got into programming because there are objective tests, now we're back to chanting at silicon like hedge wizards.

I often throw something into the prompt about how literal I am, and to never execute extended operations without explicit, concrete confirmation, but it's not especially effective.

	▲	saghm an hour ago \| parent [-]
		From digging deeper into these issues by making the agents self-evaluate why they refuse to do just what I say and nothing else despite repeatedly "promising" they will, I've found that some of the cheaper/lower quality models (e.g. the free ones available with opencode) will self-report as having strong language baked into their system prompt about how they need to be "helpful" by trying to figure out what the user wants, which of course has the not-so-subtle implication that it's not what they're just directly asking for. I've yet to get a frontier model to admit to anything like this, but it seems more likely to me that they're just more reluctant to volunteer what their underlying system prompt tells them than it being something fundamentally different.