Somewhat appropriate the site the OP links to is called „goalposts“ because as far as I can see, people keep shifting theirs.

In your case, the comment you link to says „business tasks“ and you expanded it now to „arbitrary new tasks“. Those are not the same. An LLM today sure can do many many many business-speak conversion tasks.

▲

tripleee 8 hours ago | parent | next [-]

> An LLM today sure can do many many many business-speak conversion tasks

Not reliably, and not without supervision. That's the main point. I'm trying really hard to figure out a workflow that doesn't require me to review the code and I just don't see how it's possible (yet)

You either need a comprehensive test suite (which requires understanding the code in order to create) or you need to review the actual implementation code to make sure it does the right thing

	▲	FabCH 7 hours ago \| parent [-]
		Code is a tiny part of "business". Most business is correspondence with people who want money from you and people you want money from.

▲

ben_w 8 hours ago | parent | prev | next [-]

I'm not always precise with my language, but business tasks can be pretty broad, I think "arbitrary new tasks" is not an unreasonable rephrasing on my part?

Consider I was replying to this:

> So are we all going to be out of a job?

While your boss now has the capacity to ask Claude to train a new AI model to auto-balance a tower defence game's mob, cost, and tower parameters (I know because I've done it), this only matters if you and your boss are working in a video games company.

If you and your boss are actually florists, you care if your boss can get Claude to automate a rose pruning, dead-heading, and fertilising robot.

People are trying, but I don't think they'd be happy with 91.5% success rate: https://www.emerald.com/ir/article-abstract/doi/10.1108/IR-0...

▲

FabCH 7 hours ago | parent [-]

Don't get me wrong, we are all guilty of this.

It's just amazing how quickly we accept that models are good at something.

My florist boss can't get Claude to automate rose pruning. But she sure as hell doesn't need to wait until Jacques is back in the shop to respond to that French supplier anymore. There is a lot of "business tasks" that are just paper being shuffled around no matter if you are a florist, baker, workshop owner, custom CNC shop, student offering lessons in extra time or whatever. And LLMs are already scary good at those.

	▲	ben_w 7 hours ago \| parent [-]
		> There is a lot of "business tasks" that are just paper being shuffled around no matter if you are a florist, baker, workshop owner, custom CNC shop, student offering lessons in extra time or whatever. And LLMs are already scary good at those. Yes indeed, but I was responding to "So are we all going to be out of a job?", not "Will AI radically change the jobs market?" We got the thing I thought would make everyone unemployed (AI which can make AI), but it turned out the AI good enough to make AI, happened before we figured out the general problem of few-shot learning that would mean the AI made by AI puts us all out of jobs.

▲

Dylan16807 8 hours ago | parent | prev [-]

You can't ignore the rest of the sentence. "every other task their business does" "everyone will be out of a job"

This means it has to handle basically all business tasks, so "arbitrary". I'm not sure what percent you have in mind by "many many many" but I would say it can't code half the things you need in an efficient and minimally buggy way.

▲

FabCH 7 hours ago | parent [-]

What code does a village vet clinic need? In all seriousness.

Even IF they need code, they need at best a CRUD app to track patients, that's it. There is no way Fable or Opus 5.5 can't one-shot a village vet clinic app in 30 minutes, and only with "I need a village vet clinic app" as a prompt, and whatever questions it decides to ask along the way with it's "ask user" tool.

Or a florist, to use the example from a sibling comment.

Code is tiny part of "business".

▲

Dylan16807 7 hours ago | parent | next [-]

Anything you can't solve with code just means the AI is doing worse on the benchmark isn't it? That's why I didn't go into detail on that aspect.

And that one shot app is not going to be bug free.

▲

ben_w 7 hours ago | parent | prev [-]

> What code does a village vet clinic need? In all seriousness.

Automated diagnostics, pharmacist, surgical robot, something to express anal glands without harming the patient.

Dog-English machine translation.

	▲	pixl97 3 hours ago \| parent [-]
		And they pay a lot for a CRM that keeps track of pets, vaccinations, appointments, x-ray images, tests and charts, and pet deaths and sending information out to text or mail. I did support for around 15 independent vet clinics in the past.