> The post has counts for everything that went right and nothing for what could go wrong.

That's AI for you.

At Amazon we have many forums to share our AI wins, but none to share AI failures or disappoinments.

No wonder execs make bad decisions regarding AI, they only hear completely one-sided stories.

Cthulhu_ 9 hours ago | parent | next [-]

At my company there's a lot of discussion about AI and complaints that people run out of tokens within a day, but zero results are shown. No measurable (or measured) gains. Or nothing that people are willing to talk about, in any case.

▲

KptMarchewa 7 hours ago | parent [-]

At my company the performance improvements channels has been exploding, with people claiming giant improvements in latency, throughput, and decreased cost of the services. The cost decreases itself is order of magnitude more (at annualized run rate) more than we pay for tokens. YMMV.

	▲	jpc0 7 hours ago \| parent [-]
		I hope to see more of this across the industry. I definitely make use of AI but in my experience I almost always could have done it better myself, the places where I threw AI at the problem I didn't care about the results being good, only good enough. When we see memory and compute requirements for version x+1 of software decrease instead of increase I will happily say AI is the oracle people proclaim it to be.

▲

frizlab 7 hours ago | parent | prev | next [-]

In $COMPANY, for the mid-yearly review, the employees were asked whether their AI usage was 1/ efficient, 2/ adoptive (integrated in the way they work) or 3/ transformative.

Saying “never used it” or “I tried and it was useless” was literally not possible.

▲

rpdillon an hour ago | parent | prev | next [-]

This is kind of a weird take.

If you were the CEO of Amazon, would you be setting up channels for people to talk about their AI failures? The general way technology is deployed is that we try to find ways to make it work, because those are the most interesting. We're not as interested in all the ways it doesn't work.

From my perspective, some people are trying to use AI in the same way somebody might use a laptop to paddle a canoe. Sure, you can do it, but it's not a good idea. The fact that it doesn't work well is not particularly interesting.

If I steelman your position, I guess the ideal repository would be a set of cases where it's known to work well and a set of cases where it's known to not work well. A little bit like ProtonDB or SteamDB, perhaps.

▲

warkdarrior 29 minutes ago | parent | prev | next [-]

> At Amazon we have many forums [...], but none to share AI failures or disappoinments.

I come to HN to read about AI failures and disappointments.

▲

inigyou 8 hours ago | parent | prev [-]

"It can't be that stupid—you must be prompting it wrong." - Ed Zitron