The difference is that in the factory case the faulty items are outliers and easy to spot. You throw it away and let the machine carry on making another copy. You barely lost any time and in the end are still faster than artisans, which are never in the loop.

In the AI case, you’re not making the same thing over and over, so it’s more difficult to spot problems and when they happen you have to manually find and fix them, likely throwing everything away and starting from scratch. So in the end all the time and effort put into the machine was wasted and you would’ve been better going with the artisan (which you still need) in the first place.

▲

mc32 3 days ago | parent | next [-]

A factory produces physical products and “AI” produces intellectual products. One is a little fuzzier than the other.

▲

ffsm8 3 days ago | parent | prev [-]

I don't think you've ever talked with someone in manufacturing that's in any way aware how quality assurance works there...

I can understand how you might have that misunderstanding, but just think about it a little, what kind of minor changes can result in catastrophic failures

Producing physical objects to spec and doing quality assurance for that spec is way harder then you think.

Some errors are easy to spot for sure, but that's literally the same for AI generated slop

▲

GoatInGrey 3 days ago | parent | next [-]

I spent five years working in quality assurance in the manufacturing industry. Both on the plant floor and in labs, and the other user is largely correct in the spirit of their message. You are right that it's not just up to things being easy to spot, but that's why there are multiple layers of QA in manufacturing. It's far more intensive than even traditional software QA.

You are performing manual validation of outputs multiple times before manufacturing runs, and performing manual checks every 0.5-2 hours throughout the run. QA then performs their own checks every two hours, including validation that line operators have been performing their checks as required. This is in addition to line staff who have their eyes on the product to catch obvious issues as they process them.

Any defect that is found marks all product palleted since the last successful check as suspect. Suspect product is then subjected to distributed sampling to gauge the potential scope of the defect. If the defect appears to be present in that palleted product AND distributed throughout, it all gets marked for rework.

This is all done when making a single SKU.

In the case of AI, let's say AI programming, not only are we not performing this level of oversight and validation on that output, but the output isn't even the same SKU! It's making a new one-of-a-kind SKU every time, without the pre and post quality checks common in manufacturing.

AI proponents follow a methodology of not checking at all (i.e. spec-driven development) or only sampling every tenth, twentieth, or hundredth SKU rolling off the analogous assembly line.

	▲	dimitri-vs 3 days ago \| parent [-]
		In the case of AI, it gets even worse when you factor in MCPs - which, to continue your analogy, is like letting random people walk into the factory and adjust the machine parameters at will. But people won't care until a major correction happens. My guess is that we'll see a string of AI-enabled script kiddies piecing together massive hacks that leak embarrassing or incriminating information (think Celebgate-scale incidents). The attack surface is just so massive - there's never been a better time to be a hacker.

▲

n4r9 3 days ago | parent | prev | next [-]

Yeah, a relative has worked in this area. It's eye-opening just how challenging it can be to test "does this component conform to its spec".

▲

latexr 3 days ago | parent | prev [-]

It depends entirely on what you’re building. The OP mentioned “humans fishing out faulty items” that would otherwise be built by artisans, so clearly we’re not talking complex items requiring extensive tests, but stuff you can quickly find and sort visually.

Either way, the point would stand. You wouldn’t have that factory issue then say “alright boys, dismantle everything, we need to get an artisan to rebuild every single item by hand”.