LLMs can obviously do things, so we don't disagree there; I didn't argue they couldn't do things. They can definitely act as agents of their operator.

However, I still don't think LLMs have "agency", in the sense of being capable of making choices and taking responsibility for the consequences of them. The responsibility for any actions undertaken by them still reside outside of themselves; they are sophisticated tools with no agency of their own.

If you know of any good works on nonhuman agency I'd be interested to read some.