Remix.run Logo
roflmaostc 4 hours ago

Partially agree. However, this problem has existed with scam e-mails since the 90s.

For me the solution is in signed e-mails and signed documents. If the person invites me to a online meeting with a signed e-mail, I trust that person that it's really them.

Same for footage of wars, etc. The journalist taking it basically signs the videos and verifies it's authenticity. It is AI generated, then we would loose trust in that person and wouldn't use their material anymore.

TheOtherHobbes 4 hours ago | parent | next [-]

How do you prove the signature isn't fake?

Ultimately ID requires either a government ID service, a third party corporate ID service, or some kind of open hybrid - which doesn't exist.

All of those have their issues.

olmo23 3 hours ago | parent | next [-]

I think he was referring to a cryptographic signature, possibly using the "web of trust" to get the key. I'm not convinced we need central authority to solve this.

tenacious_tuna 3 hours ago | parent | prev | next [-]

people at my org were gleeful when they learned they could hook LLMs into Slack. Even if we had some reliable, well-used signature system, I think people would just let AI use it to send emails on their behalf.

bigfishrunning 3 hours ago | parent | next [-]

If the AI age has taught me anything, it's that most people do not care what their output is. They'll put their name on anything, taste or quality does not matter in the least. It's incredibly depressing.

Ajedi32 2 hours ago | parent | prev | next [-]

That's a different problem though. It's doing it on their behalf, not on behalf of a scammer who's impersonating them.

pixl97 15 minutes ago | parent [-]

Until their computer is taken over....

MarsIronPI an hour ago | parent | prev [-]

Well we should treat that as their own output. If it's crap, treat it the same way you would if they produced the crap themselves.

SirMaster 37 minutes ago | parent | prev [-]

Same way security cameras prove that they are authentic camera recordings that have not been modified. If modified, the video will no longer match the signature that was generated with it.

mk89 3 hours ago | parent | prev | next [-]

There are people hosting agents online to talk to other agents etc. on their behalf. How difficult is it to just instruct such an agent to do the tasks you mentioned? You're assuming it's done by "bad actors" while it's most likely just going to be done by "everyone" that knows how to do it.

strogonoff an hour ago | parent | prev | next [-]

As with any problem, scale changes its nature.

With cash, you can only steal so much (or have transactions of up to certain size) until you run into geographical and physical constraints. With cryptocurrency, it’s possible to lose any amount.

With humans writing scam emails, you can only have so many of them until one blows the whistle. With LLMs, a single person can distribute an arbitrary amount.

At some point, quantity becomes a new quality, and drawing a parallel becomes disingenuous because the new quality has no precedent in human history.

pixl97 14 minutes ago | parent [-]

> (or have transactions of up to certain size)

And by that you mean tens of millions to billions right? Bank transfer scamming/fraud is a thing.

strogonoff 2 minutes ago | parent [-]

The highlighted parallel is usually drawn between cryptocurrency and cash, not between cryptocurrency and banks. With both cash and cryptocurrency, as is the idea behind the analogy, 1) there’s no intermediary and 2) once it’s gone, it’s gone. Obviously, the banking system is not immune to fraud (not sure why you think I made that claim), but banks can (and sometimes do) resolve these cases and have certain KYC requirements.

hansonkd 2 hours ago | parent | prev | next [-]

I mean emails were and still are a huge security risk. Sometimes I'm more scared of employees opening and engaging with emails than I am than anything else.

Forgeties79 4 hours ago | parent | prev [-]

Spam emails in the 90’s don’t come remotely close to the operations people can set up by themselves with AI now. It doesn’t even compare.