> humans can be held accountable and learn from their mistakes

bad bots can be retrained or shut down far more easily

depending on which model one is using, and the error the employee needs to be retrained on, i strongly disagree that you can retrain an llm as easily as you can a person.

particularly most of the commercial models.

again, i’m sure we can all come up with a thousand “hypotheticals”, and tbh, the hypothetical parade is not something i’m interested in having. but i’ll state again, “entirely removing humans” from the situation is silly-tier thinking.

particularly as even the ceos of sota frontier producing models will each and every single one tell you to never trust their model.

“our model is smartest thing in the world…”

…next breath..

“wait, you trusted our model? that was silly of you. always double check it”

But in government humans are fired all the time! (Especially in mature western democracies)

If I instruct an employee to prioritize my profit in a way that opens both of us to criminal prosecution, there is a non zero chance of them whistle blowing or even cooperating with the authorities to prosecute me.

I don't see such a path with an llm.