Remix.run Logo
mjr00 15 hours ago

> On April 4, 2024, it was revealed that Amazon's "Just Walk Out" technology was supported by approximately 1,000 Indian workers who manually reviewed transactions. Despite claims of being fully automated through computer vision, a significant portion of transactions required this manual verification. ( https://en.wikipedia.org/wiki/Amazon_Go )

Wonder how much of this is due to economics since computer vision tech never reached the expected performance + outsourced workers got (relatively) much more expensive after COVID.

Cornbilly 14 hours ago | parent | next [-]

It's great that they faced essentially no consequences for this. A sure sign that we have a functional and sane market.

colinplamondon 14 hours ago | parent | next [-]

Why would they face consequences? Every store has video surveillance that can be reviewed.

They trusted their tech enough to accept the false-positive rate, then worked to determine / validate their false positive rate with manual review, and iterate their models with the data.

From a consumer perspective the point is that you can "just walk out". They delivered that.

acdha 14 hours ago | parent | next [-]

If the stock price goes down, I won’t be surprised if there’s a shareholder lawsuit claiming that they misrepresented their level of AI achievement and that lead to this write-off by keeping operating costs and error rates high. The whole business model really assumed that they could undercut competitors by lower staffing.

Cornbilly 13 hours ago | parent | prev [-]

Their initial advertising claimed near full automation by their "AI" system when, in reality, they had people manually handling around 70% of the transactions.

I get that this is a message board for YC, so lying about your company's tech is considered almost a virtue but that is an unreasonably big lie to tell without getting your hand-slapped by some regulatory body or investor backlash.

neilc 13 hours ago | parent | next [-]

I don’t remember Amazon claiming “near-full automation” by AI. They said that you can checkout automatically and that AI/computer vision is somehow involved.

thegrim000 7 hours ago | parent | prev | next [-]

Well that's because, again, it was indeed algorithms doing the work, and the people were only used to verify / train the system, after the fact. People keep, intentionally, conflating the two things, doing everything in their power to say (or strongly imply), that the people involved were managing the orders in real time, which is a lie. You are the one pushing misinformation here.

colinplamondon 13 hours ago | parent | prev | next [-]

I think investors like Amazon taking shots like this? It was never a broad roll-out, 43 stores is micro-scale for Amazon.

Still, would love to see a breakdown of why it didn't improve. Regardless of the accuracy at launch, I'd think that advances in AI would have been massively to their advantage. I wonder if security degradation hit them hard.

The entire system depends on a level of social trust that doesn't exist in American cities today. Similarly, the "Dash Cart" seems like a cheaper and easier way to accomplish the same thing.

At the end of the day, there's also a mismatch in the use case. If I'm going to a smaller format store, like they had, I'm not buying a ton of stuff. Self checkout is great, and minimal friction.

I'd think that improving the UX of self-checkout gets 80% of the way there with way less fraud, way less theft, and way less technology.

Still, I think it's wicked cool they took a big shot.

I know someone that worked on the project in the early days. It was always incredibly difficult technology, they were always behind on their accuracy targets, and the solutions were increasingly kludgy as they layered more and more complex systems on top. An honorable failure.

A lot of smart people really tried to make it work.

Cornbilly 12 hours ago | parent [-]

That's great but they could have been honest up-front and said "The plan is that this is eventually fully-automated but we estimate that it needs supervised training for X amount of time in order to handle Y% of transactions automatically".

But this is tech and you just lie because hardly anyone in the investor class knows enough to call you out on it or they are just going with the lie to make a buck off of other rubes.

Privacy concerns aside, I thought it was a cool project. I agree that “convenience store” was probably not the best target but I think it was an effective enough proof of concept (creating a decent sized chain of them probably wasn’t the best idea) . I’ve seen the system used more effectively in smaller situations like stadium concessions, where the duration of the transactions needs to be very short to facilitate throughout.

CamperBob2 6 hours ago | parent | prev [-]

Who cares how they monitor and validate transactions? That's Amazon's problem, not mine.

Indians, AI, whatever, meh.

madeofpalk 6 hours ago | parent | prev | next [-]

Isn't the consequence that that they're shutting the stores down?

jandrese 13 hours ago | parent | prev [-]

What's the crime? If lying about AI capabilities is a crime we have some billionaires in big trouble.

kube-system 11 hours ago | parent | next [-]

If it's a publicly traded company, everything is securities fraud.

jandrese 11 hours ago | parent [-]

Which hardly anybody ever gets prosecuted for.

kube-system 9 hours ago | parent [-]

Criminally, no. In a class action? every day.

Cornbilly 12 hours ago | parent | prev [-]

AI is not unique in this regard. We just saw the same thing with the crypto/blockchain nonsense.

Regulation lags so far behind that you can get away with bad behavior long enough that, by the time regulation catches up, you can buy your way out of consequences.

ed_mercer 13 hours ago | parent | prev | next [-]

This was proven to be false on the WAN show. Only 20% of transactions were low confidence and handled by mechanical turk.

https://m.youtube.com/watch?v=433kipkEERY&t=8479s

larrik 12 hours ago | parent | next [-]

20% seems like a "significant portion" to me

whateveracct 2 hours ago | parent | prev | next [-]

Transactions or grabs? Cuz I grab >5 things every time..so it stands to reason Indians always reviewed me.

mjr00 12 hours ago | parent | prev | next [-]

20% is an incredibly high number though, if a store has 400 people/hour that means you're manually reviewing 80 transactions per hour, over one transaction per minute. That's multiple human employees.

iLoveOncall 10 hours ago | parent [-]

One transaction per minute is nothing at all when the transaction can be as simple as "did the person put that back on the shelf" with a 5 seconds clip.

pessimizer 12 hours ago | parent | prev [-]

Proven "false." I've noticed that if one admits the truth with a dismissive or offended tone, you can just continue to claim the lie and through sheer force of will people will still go with it.

I think people just think that they must be misunderstanding something; that nobody could claim one thing while offering evidence of its opposite. 1/5 of purchases lose their significance.

theanonymousone 15 hours ago | parent | prev | next [-]

Why did "outsourced workers get (relatively) much more expensive after"?

foxyv 15 hours ago | parent | next [-]

Essentially the thinking went. If everyone is remote, why not hire remote workers from countries that are a lot cheaper. Suddenly you had a hard time finding contractors and FTEs from those countries because everyone was hiring them. At the same time it got really hard for entry level developers in the USA to find work.

The supply/demand curve shifted and now those workers are becoming more expensive while domestic workers are becoming cheaper.

mjr00 15 hours ago | parent | prev | next [-]

Great question. I'm not an economist so I have no idea why. The outsourcing rates I've all seen have gotten way higher in the past ~10 years though.

Insanity 15 hours ago | parent [-]

Beyond just the usual inflation?

I'm not an economist either, but I also assume that as the country attracts more local talent for local companies, the competition for outsourcing becomes harder. (i.e, you now have to pay more than the local companies).

All just speculation on my part though, I really have no clue either.

PaulHoule 14 hours ago | parent [-]

People from Bangalore were telling me it was getting crazy expensive to live there (by Indian standards) circa 2013.

giraffe_lady 15 hours ago | parent | prev [-]

India specifically is in the middle of a massive years-long labor movement that is changing the terms of work there and I believe shifting the degree of alignment with western corporate outsourcing though I'm not very informed about the details.

Scale is beyond comprehension though, there were 250 million people on strike one day last summer. This is not ever really covered in western media or mentioned on HN for reasons that are surely not interesting or worth pondering at all.

givemeethekeys 14 hours ago | parent [-]

Americans can’t afford to strike like that.

linkregister 14 hours ago | parent | next [-]

You're most likely correct; I originally started writing this comment to refute your statement, but found that my assumptions appear to be wrong.

Americans have the nearly the highest nominal and PPP income of OECD countries as of 2024, only behind Luxembourg, Iceland, and Switzerland [1].

India experiences substantially higher shelter and food insecurity and poverty rates than the United States.

However, tech workers in Bangalore are paid an order of magnitude higher than prevailing local wages in other sectors, at around ₹2M (₹20 lakh) [2]. Median annual rents for 2BHK (2 bedroom) apartments appear to be around 1/10th of that figure at ₹3 lahk in desirable neighborhoods [3].

It appears to be reasonable for a technology worker to be able to perform a sustained strike. I have never personally traveled to Bangalore, though I have lived in places where cost of living is under a tenth of median American income.

I invite correction by people with first hand knowledge about cost of living in Bangalore.

1. https://www.oecd.org/en/data/indicators/average-annual-wages...

2. https://timesofindia.indiatimes.com/city/bengaluru/median-te...

3. https://www.birlaevara.org.in/best-areas-in-bangalore-for-re...

leosanchez 13 hours ago | parent | next [-]

> It appears to be reasonable for a technology worker to be able to perform a sustained strike.

I don't think the strikes are done by tech people at all. Just normal workers.

linkregister 8 hours ago | parent [-]

Then indeed these striking workers are doing so bravely, especially in comparison to the wealth of American workers.

dragonwriter 13 hours ago | parent | prev [-]

> However, tech workers in Bangalore are paid an order of magnitude higher than prevailing local wages in other sectors

250 million people striking in India isn't mainly “tech workers in Bangalore”, or mainly tech and other elite workers at all. It’s about 40% of Indian workers, and most articles I've seen about it centered on widespread participation of workers in coal, construction, and agricultural sectors.

linkregister 8 hours ago | parent [-]

Thank you for the correction. Indeed these workers' livelihoods are more perilous than their American contemporaries.

dragonwriter 13 hours ago | parent | prev | next [-]

No one (at a national scale) can afford to strike like that, except people who have an understanding of why they even more can't afford not to strike like that.

netsharc 13 hours ago | parent | prev | next [-]

And Indians can?

When India "shut down" for Covid, day labourers suddenly had no income, and no government support - they had to walk all the way to their home province (can't remember if the trains were even running).

But oh well, Uberizing employment means the run-of-the-mill American worker can also live like that in the future... progress!

giraffe_lady 13 hours ago | parent [-]

Americans have chosen to learn exactly how good they have had it. You get to watch!

esseph 13 hours ago | parent | prev [-]

Can't afford not to.

adamsb6 12 hours ago | parent | prev | next [-]

People don’t know what the H is in RLHF.

thinkingtoilet 15 hours ago | parent | prev [-]

Another case where AI = "actually Indians". It's funny how often this has happened.

Dylan16807 14 hours ago | parent | next [-]

Maybe. I'd really want to know what percent of items (not transactions) needed review. 1,000 people to oversee how much revenue?

Theoretically if it was 99% computer and 1% human, that's enough to mess up the economics but it's not a bait and switch like some companies have done.

kkkqkqkqkqlqlql 8 hours ago | parent | prev [-]

I remember this case the one who put "Actually Indians" in my mind. What other instances do you know?

(Not to refute your point, of course, I am just curious)

Sateeshm 8 hours ago | parent [-]

Builder ai