Remix.run Logo
▲ chilmers 2 hours ago

I think properly-trained AI agents will have a huge advantage against humans in such contexts: They will have no intrinsic tendency towards laziness. I think most humans have a natural inclination to optimise the amount of work we do in a professional setting, unless we really happen to enjoy it doing it for the sake of it. We can fight against this by setting up processes and incentives, but we'll always be going against a tendency deeply ingrained by evolution to minimise our mental energy expenditure and to avoid repetitive, tedious or boring tasks.

On the other hand, with AI we'll use reinforcement learning to create agents without such evolved-in tendencies. Where (so long as we can solve alignment and cheating) they are trained to do the job, no matter how much effort it takes, or what's involved.

▲dasil003 6 minutes ago | parent | next [-]

Of course AI also has trained in tendencies following the incentives of the creators. Just as laziness is an energy saving technique with high evolutionary value, so is busybody makework for AI agents. Have you noticed how claude always has a couple loose ends and a suggestion for next step at the end of every session? Nothing is ever done—that's good for token spend, and can easily create an illusion of productivity.

But when it comes to audits/compliance, it's mostly a cost center meant to mitigate risk. Going deeper may be valuable, but it can also add costs in terms of time and attention that just aren't worth it—this is the balance that human auditors walk every day, and it's in a squishy human domain where AI really struggles to demonstrate any common sense let alone street smarts, instead acting like an extremely precocious 13-year-old with no sense of human incentives or tacit understandings.

▲nonethewiser 14 minutes ago | parent | prev | next [-]

>I think properly-trained AI agents will have a huge advantage against humans in such contexts: They will have no intrinsic tendency towards laziness.

Or just being tired. Auditors are famously run into the ground.

I think you are right. Auditing is a pretty standard procedure. There is real tricky investigation sometimes but for the most part the formula is to throw data into a rules engine. And there are robust processes in place for handling mistake. There are consequences for errors. If they incur too high of a cost for the firms they will reform the can reform their strategies.

▲wongarsu an hour ago | parent | prev [-]

LLMs absolutely suffer from lazyness. Both reinforcement- training environments and benchmarks have token limits, which makes giving 100% on every subtask disadvantageous

They are less lazy than humans though

▲nonethewiser 12 minutes ago | parent | next [-]

I think that's more of akin to some form of reasoning capacity than laziness (or becoming tired, really).

It has a max capacity but you can just loop it forever with that max capacity.

You cant loop a human forever without dropping mental capacity.

▲disgruntledphd2 an hour ago | parent | prev | next [-]

They are differently lazy from humans. They'll happily bang their heads against a wall to make something work, but they'll almost never step back to consider a different approach.

▲jtmarl1n an hour ago | parent | prev [-]

Is that laziness or just resource constraints

▲foota 13 minutes ago | parent [-]

I think their point is that resource constraints (both at training time and inference time) lead to trained in laziness in the model. If there were no resource constraints we would train less lazy models.

▲nonethewiser 7 minutes ago | parent [-]

OK. So enslave it. Make it work forever. Who cares.