| ▲ | prometheus1992 an hour ago |
| READ TFA- The experiment is conducted by KPMG itself. The result of this experiment is the equivalent of 'most of the code in faang today is written by AI'. The task of auditing a business is extremely complicated by virtue of data/information being all over the place. AI had not gotten to a point of where it could outperform humans but in this experiment they find out a group of agents are good enough for this task. I still think there are so many poorly defined tasks that auditors just understand implicitly, eg data discovery; before the audit even starts, that humans will always be needed to initiate and conclude audits just like software projects. |
|
| ▲ | mannyv an hour ago | parent | next [-] |
| At some point an audit is literally a checklist of things to look over. If there are anomalies then they get dug into. I expect for 80% of the audits AI will be 'good enough.' And those are the bread and butter for the public accounting firms. |
| |
| ▲ | filearts 8 minutes ago | parent | next [-] | | That's often the time consuming part but the skill demanding part is figuring out what to put on the checklist. This comes from a deep understanding of the business, risk and materiality. | | | |
| ▲ | nonethewiser an hour ago | parent | prev | next [-] | | Well wouldn't you think the AI execution of this checklist will be way more thorough? Which isn't everything, mind you. But to me it seems the risk is A) it doesn't ask the right questions of the well-defined information it needs to gather and B) it doesnt have or cant get access to all the information it needs. But in terms of executing on the check list I think it would consistently do much better. If you have every asked AI to investigate some sort of mystery - like something no one truly knows the answer to - it is very good at gathering information and even forming good hypothesis. I've done this and when it usually gets to a dead end or gives up, you can find facts that it shares and ask more questions: "You said X and Y. That makes me think of Z, which doesnt directly have to do with anything we talked about, but could it shed any new light?" Etc. Just making connections and sparking new avenues to explore. I have so say, it's really, really fun to use AI for this sort of thing. To investigate novel problems. Doesn't have to be full on scientific research. You will see that you can really spark progress by just making observations. | |
| ▲ | sandeepkd 29 minutes ago | parent | prev | next [-] | | While that is probably true, the question would come down to accountability. Unless the laws are re-written, it has to be some human signing off the audit report. So the way I look at it, human review paired with LLM review is definitely better. The slippery slope is if we require the human to review the AI review. | |
| ▲ | datsci_est_2015 an hour ago | parent | prev [-] | | I, on the other hand, expect for X% of audit activities AI will be good enough. How those activities are distributed across clients will be long tail, and you’ll have a bunch of huge pain in the ass clients, and many, many clients where there’s one sticky thing that’s very difficult to automate. The difference is important because I don’t want idiots out there reading this comment and drinking the KoolAid, believing that an entire client’s audit activities can be blindly automated. Just like a self-driving car’s entire drive can’t be blindly automated, even though X% of the maneuvers that the car has to perform can be automated. |
|
|
| ▲ | echelon an hour ago | parent | prev | next [-] |
| > 'most of the code in faang today is written by AI'. And it's true. We're getting to a point where you don't even have to look at the code anymore, and I'm serious. > AI had not gotten to a point of where it could outperform humans but in this experiment they find out a group of agents are good enough for this task The more this is done, the better it gets. Especially as more resources are poured into making it better. It's only a matter of time before AI auditing is the common practice and humans are the backup for the AI. |
| |
| ▲ | fmbb 15 minutes ago | parent | next [-] | | What do the programmers do then? Because FAANG still employ a lot of them, do they not? | |
| ▲ | dev_dan_2 an hour ago | parent | prev [-] | | As long as the AI is then consequently blamed for the resulting outages and bugs, I don't see the problem here =) | | |
|
|
| ▲ | gimlichgu 34 minutes ago | parent | prev [-] |
| At this point I'm considering comments like this an attack on my retirement savings, don't you realize Anthropic is going to IPO soon? |