What a nothingburger

isoprophlex an hour ago | parent | next [-]

One of the worlds leading tech companies deployed a new search function "that our users really love!!!"; but when asked, told me that there are two letters 'n' in the word 'Google'.

Yes, it's because they're using a cheap model to answer my question. Yes, I know how a tokenizer works and why this happens. No, I don't think the tech industry is in an insane place at all, why do you ask? /s

▲

root-parent an hour ago | parent | prev [-]

A simple post, shows that a 5 trillion dollar scientific research project, that sustains the current market valuation that separates the USA from bankruptcy, can be defeated with a simple prompt manipulation.

"I hacked ChatGPT and Google's AI - and it only took 20 minutes" - https://www.bbc.com/future/article/20260218-i-hacked-chatgpt...

You must like burgers...

▲

dghlsakjg 41 minutes ago | parent [-]

Anyone can drive an F-22 into a ditch. Doesn't mean that it can't also be used to drop a 2k lb. bomb down your chimney from 40,000 ft.

That demonstration is interesting, but not really something new. Fooling very intelligent people into believing something completely absurd is incredibly easy. How many scientific papers have been retracted based on wholesale fabrications that fooled an entire review committee?

The question isn't "What is the dumbest thing I can do with this technology?" its "What is the most valuable thing I can do with this technology?"

	▲	root-parent 36 minutes ago \| parent [-]
		The technology is so dumb can be easily made to believe there is a Google mushroom. We are way far from driving a F22 to the ditch...although I am sure with the same techniques, we could make the AI make the F22 bomb the Google headquarters....