Remix.run Logo
adidoit 7 days ago

Very impressive.

I have to say while I'm deeply impressed by these text to image models, there's a part of me that's also wary of their impact. Just look at the comments beneath the average Facebook post.

postalcoder 7 days ago | parent | next [-]

I have been testing google's SynthID for images and while it isn't perfect, it is very good, insofar that I felt some relief from that same creeping dread over what these images will do to perceived reality.

It survives a lot of transformation like compression, cropping, and resizing. It even survives over alterations like color filtering and overpainting.

sigmar 7 days ago | parent [-]

facebook isn't going to implement detection though. Many (if not most) of the viral pictures are AI-generated. and facebook is incentivized to let their users get fooled to generate endless scrolling

paul7986 7 days ago | parent | next [-]

Along with those being fooled there are many comments saying this is fake, AI trash and etc. That portion of the commenters are teaching the ignorant and soon no one will believe what they see on the Internet as real.

bonsai_bar 7 days ago | parent [-]

> soon no one will believe what they see on the Internet as real.

Now is that so bad?

qingcharles 7 days ago | parent | prev [-]

They already did. Certainly on the backend. For a while they were surfacing it, but I think it's gone again. But Meta is definitely onto this.

betterhealth12 7 days ago | parent | prev | next [-]

I think it's time to build a new system - something that can annotate the post the user is on, if there's at least another savvy user (or AI system) that can pick up on the uncanny signals. This youtube video about the "Walker Family" sham on Facebook is particularly relevant here:

Don’t Pay This AI Family To Write You a Song - https://www.youtube.com/watch?v=u-DDHSfBBeo

nikanj 7 days ago | parent | prev | next [-]

The comments are probably AI-generated too, because a site that seems to have lots of other people on it is more appealing than an empty wasteland

MitPitt 7 days ago | parent | prev | next [-]

Facebook comments are obviously botted too

bee_rider 7 days ago | parent [-]

I dunno, I thought so for a while, but I’m beginning to suspect this is a very optimistic view of humanity.

artursapek 6 days ago | parent [-]

Why do HN commenters all act like they're in the top 1% of intellectuals

knicholes 7 days ago | parent | prev [-]

[flagged]

yifanl 7 days ago | parent | next [-]

This presumes that you're okay with giving the real Elon your wallet but not a fake Elon, but why?

knicholes 7 days ago | parent | next [-]

It was very convincing. We thought it was a YouTube stream of the Starship launch. It paused with 40 seconds remaining, and "Musk" came on offering to reward those who support innovation and technology (BTC, in this case). All info here: https://docs.google.com/document/d/1lRbApgKT4U95zN0AYsPQqsLR...

yifanl 7 days ago | parent | next [-]

My problem with your statement isn't if its believable Elon came on stage or not, my problem is why would you trust Elon to pay you your money back, whether its the authentic or imposter Musk.

Jordan-117 7 days ago | parent | prev [-]

Kind of missing their point there. Giving Elon Musk $15k in crypto based on some vague too-good-to-be-true "trust me bro" pitch is embarrassing even if the video turned out to be real.

FergusArgyll 7 days ago | parent [-]

The guy lost 15k there's no need to rub it in!

Jensson 7 days ago | parent | prev [-]

Because it isn't worth real Elon's time to run these scams.

pil0u 7 days ago | parent | prev | next [-]

I got scammed similarly (although $10, because I tested first), because 1. it was on YouTube, on a channel called "SpaceX" with verified logo 2. with hundreds of thousands of viewers live 3. with a believable speech from Mr. Musk standing next to its rockets (and knowing his interest in cryptocurrencies).

This happened as I was genuinely searching for the actual live stream of SpaceX.

I am ashamed, even more so because I even posted the live stream link on Hacker News (!). Fortunately it was flagged early and I apologized personally to dang.

This was a terrible experience for me, on many levels. I never thought I would fall in such a trap, being very aware of the tech, reading about similar stories etc.

dvh 7 days ago | parent | next [-]

I am flabbergasted that you both get scammed. I would understand if this was two years ago, but now? Do people really not know about these scams? I can already see down votes coming for victim blaming, but this is to me really shocking. Notice that there isn't "tell hn: don't get scammed by deep fake crypto Elon" because people who usually posts also consider this general knowledge. That's why it's so effective I guess. In a similar manner there will never be "tell hn: don't drink acid it will burn your intestines", the danger is so obvious that nobody feels the need to post it and because nobody is posting it, people get scammed. I don't know what is the solution to that. How should you tell people what everybody should be already knowing?

I remember being on a machining workshop and he was telling such an obvious things. Obvious things are obvious until they aren't, and then somebody gets hurt.

knicholes 7 days ago | parent | next [-]

Yes, I've heard about these scams. I've made deepfakes myself in the past. I've openly mocked people who have fallen for these scams. But this was sophisticated. Perfectly timed, very convincing deepfake, popular YouTube channels showing this stream during the launch, as if it were legit. The website was branded as SpaceX (the domain was obviously not, but I wasn't vigilant in the exciting hullabaloo of the impending launch). The instructions to participate were clear and easy to use.

bn-l 7 days ago | parent | prev | next [-]

Hey it takes courage to admit to it. That’s admirable.

SXX 7 days ago | parent | next [-]

This. Dont be ashamed. Everyone can get scammed.

Reason people do is because we dont talk of risks often enough.

knicholes 7 days ago | parent | prev | next [-]

I am so deeply ashamed.

Kurtz79 7 days ago | parent | prev [-]

Yes, thanks OP for sharing. I check HN front page mostly everyday and had no clue such sophisticated scams existed (I pretty much don’t use social media).

It’s easy to think “eh, it will never happen to me” but hindsight is 20/20. I impulse-donated to things like Wikipedia in the past and I’m susceptible to FOMO as most people.

pil0u 7 days ago | parent | prev [-]

To be fair, if that was only $10 it's because it was more of a "let's see if that works". It was believable enough to try this out.

The point of my message was to "tell hn: it could happen to people in this community".

knicholes 7 days ago | parent | prev [-]

Yes, this is the exact same scam.

betterhealth12 7 days ago | parent [-]

@knicholes & @pil0u - I am working on a system that would prevent this exact same scenario. I appreciate the docs write up, given that you were personally impacted by this and are passionate about it, I'd love to speak.

I feel like the scale at which this is happening cross-internet must be staggering but because this is small-scale and un-reportable theft - who would the average person even go to, if they willingly sent the money, and they'd also have to get over the embarrassment of having fallen for it.

What really got me thinking about the scale of this is watching the deepfake discussion at 1:51:46 in this video (at 1:52:00 he says his team spends 30% of their time sorting through deepfake ads, to the extent he had to hire someone whose exclusive job is to spot these scam videos and report them to FB etc):

https://youtu.be/JMYQmGfTltY?si=ntuDgXuhMYj2fh5z&t=6706

fxtentacle 7 days ago | parent | prev | next [-]

Plot twist: It wasn't a deepfake.

You sent your wallet to the real Elon and he used it as he saw fit. ;)

pjerem 7 days ago | parent [-]

That’s what they said : they have been scammed !

kamranjon 7 days ago | parent | prev | next [-]

Would you consider writing a blog post about this experience? I'm incredibly interested in learning more details about how this unfolded.

knicholes 7 days ago | parent | next [-]

Yeah, here it is, along with screenshots. https://docs.google.com/document/d/1lRbApgKT4U95zN0AYsPQqsLR...

qingcharles 7 days ago | parent | prev | next [-]

I think the comment is a joke. Their bio is satirical at least :)

nerevarthelame 7 days ago | parent | next [-]

Their bio mentions their actual job and one project that is verifiably real. I think that the elements that seem satirical are real projects they're working on.

lucasmullens 7 days ago | parent | prev [-]

I'm pretty sure the comment wasn't a joke? I saw the stream last week, it was very impressive use of AI, I didn't realize it was AI until he started talking about doubling crypto.

What about the bio is satirical? I'm pretty sure that's sincere too.

qingcharles 7 days ago | parent [-]

User has edited their bio now :)

knicholes 7 days ago | parent [-]

I didn't edit my bio. My projects are not satire. I'm just less ashamed than most, so I work on more "exciting" projects. I've worked extensively with generative AI, including video, myself. It was just that convincing to me in the moment. My regret knows no bounds. Luckily I earn enough this doesn't devastate me, but I really could have done some good with that money.

qingcharles 7 days ago | parent [-]

Yikes. In that case, please accept my apology. Your bio disappeared for a while off your page, but it's back as it was now.

paul7986 7 days ago | parent | prev [-]

Well just go on this guy's lawn and you will find your answer lol

Imustaskforhelp 7 days ago | parent | prev | next [-]

Please pardon me since I don't know if this is satirical or not. I'd wish if you could clarify it.

Because if this is real, then the world is cooked

if not, then the fact that I think that It might be real but the only reason I believe its a joke is because you are on hackernews so I think that either you are joking or the tech has gotten so convincing that even people on hackernews (which I hold to a fair standard) are getting scammed.

I have a lot of questions if true and I am sorry for your loss if that's true and this isn't satire but I'd love it if you could tell me if its a satirical joke or not.

bauruine 7 days ago | parent | next [-]

I guess it was something like [0] The Nigerian prince is now a deep fake Elon but the concept is the same. You need to send some money to get way more back.

[0]: https://www.ncsc.admin.ch/ncsc/en/home/aktuell/im-fokus/2023...

Imustaskforhelp 7 days ago | parent | next [-]

hm, but isn't it wild thinking that elon is talking to you and asking you for 15k , like bro has the money of his lifetime, why would he ask you?

It doesn't make that much sense idk

atrus 7 days ago | parent | next [-]

I remember watching the SpaceX channel on youtube, which isn't a legit source. AI Elon basically says "I want to help make bitcoin more popular, let me show you how easy it it to transfer money around with btc. Send my $X and I'll send you back $2X! It's very inline with a typical elon message (I'll give you 1 million to vote R), it's on a channel called SpaceX. It's pretty believable.

Granted I played Runescape and EvE as a kid, so any double-isk scams are immediate redflags.

empath75 7 days ago | parent | next [-]

It's only believable to the extent that I believe that Musk would actually run such a transparently obvious scam.

Imustaskforhelp 7 days ago | parent | prev [-]

Now I have never played runescape but have heard of this legendary game in references.

For some reason, my mind confused runescape with neopets from the odd1sout video which I think is a good watch.

Scams That Should be Illegal : https://www.youtube.com/watch?v=XyoBNHqah30

Jensson 7 days ago | parent | prev [-]

Even Elon could lose his credit card or something, the story they spin is always something like that "I am rich but in a pickle, please send some money here and then I'll send you back 10x as much tomorrow when I get back to my account", but of course they never send it back.

Edit: But of course Elon would call someone he knows rather than a stranger, rich people know a lot of people so of course they would never contact you about this.

tantalor 7 days ago | parent | prev [-]

That's an "advance fee" scam.

https://en.wikipedia.org/wiki/Advance-fee_scam

runarberg 7 days ago | parent | prev | next [-]

There are a lot of people on the internet, and every individual on the internet is in a unique situation. Chances are some of them are very likely to be persuaded by a scam which seems obvious to you.

Parent’s story is very believable, even if parent made this particular story up (which I personally don‘t think is the case) this has probably happened to somebody.

Imustaskforhelp 7 days ago | parent [-]

Ya maybe I didn't get their tone correctly which is why I was actually serious if they were joking or not.

If they aren't joking, I apologize.

knicholes 7 days ago | parent | prev [-]

Not satire. He made a big speech about rewarding those who invested early in tech to move humanity forward and the benefits of the blockchain. It was extremely convincing. Three college grads and a medical doctor were all convinced.

jaredklewis 7 days ago | parent | prev | next [-]

This comment is perfect.

latchkey 7 days ago | parent [-]

As always, it is the replies that make it worth it. GopherGeyser strikes again!

knicholes 7 days ago | parent [-]

You don't like the idea of GopherGeyser?

latchkey 7 days ago | parent [-]

What are you talking about? I ordered 10 of them.

knicholes 7 days ago | parent [-]

You couldn't have-- we sold out and are out of stock redesigning the board to be more usable during configuration and radio control.

latchkey 7 days ago | parent [-]

Oh shit, it is a real product? That's amazing.

michelb 7 days ago | parent | prev | next [-]

These SpaceX scams are rampant on youtube and highly, highly lucrative. It’s crazy and you have to be very vigilant, as whatever is promised lines up with Elon’s MO.

rangerelf 7 days ago | parent | next [-]

Why would anyone give them any money AT ALL?

It's not like they're poor or struggling.

Am I missing something?

nickthegreek 7 days ago | parent | prev | next [-]

it requires zero vigilance if you dont play the game.

ablation 6 days ago | parent | prev [-]

My mind is blown that people would engage in it at all, let alone need to be "vigilant". Amazing.

lionkor 7 days ago | parent | prev | next [-]

Not to victim-shame or anything, but that sounds more like more than one safety mechanism failed, the convincing tech only being a rather small part of it?

knicholes 7 days ago | parent | next [-]

Yes, more than one safety mechanism failed. Coinbase actually flagged the transaction, but I was so desperate to get it to go through, I went through their facial validation process to expedite the transaction. If I hadn't for just a couple more minutes, I'd have realized it was a scam.

prawn 7 days ago | parent [-]

Scams usually have an element of urgency so you don't stop to think.

Why did you and your graduate friends think an insanely rich man with a huge number of staff needed your financial help in testing transactions? This reminds me of those people that fall for celebrity love scams, where a rich celebrity needs their money - just baffling.

hansonkd 7 days ago | parent | prev [-]

I think the biggest failure is on the part of the companies hosting these streams.

Its been a while, but I remember seeing streams for Elon offering to "double your bitcoin" and the reasoning was he wanted to increase the adoption and load test the network. Just send some bitcoin to some address and he will send it back double!

But the thing was it was on youtube. Hosted on an imposter Tesla page. The stream had been going on for hours and had over ten thousand people watching live. If you searched "Elon Musk Bitcoin" During the stream on Google, Google actually pushed that video as the first result.

Say what you want about the victims of the scam, but I think it should be pretty easy for youtube or other streaming companies to have a simple rule to simply filter all live streams with Elon Musk + (Crypto|BTC|etc) in the title and be able to filter all youtube pages with "Tesla" "SpaceX" etc in the title.

lionkor 7 days ago | parent | next [-]

I feel like somehow that would lessen it, but not really help much? There are obviously people with too much money in BTC who are trying to take any gamble to increase its value. It sounds like a deeper societal issue.

jfoster 7 days ago | parent [-]

You are right that they might never be able to get it to 0, but shouldn't they lessen it if a simple measure like the one described can prevent a bunch of people from getting fooled by the scam?

betterhealth12 7 days ago | parent | prev [-]

What are your thoughts on this being solved by the negative of the situation? So, instead of having to vet every single stream, tweet etc to check if it's legit, basically the idea is that you shouldn't "trust" what you are seeing unless it's explicitly endorsed via a signature from the original creator.

Obviously, if it's coming from their official channels the "signature" can be more obvious, but a layer that facilitates this could do a lot of good imo.

AbraKdabra 7 days ago | parent | prev | next [-]

I don't mean to be rude, but this sounds like natural selection doing its work.

umbra07 7 days ago | parent | next [-]

That's the sort of statement that remains extremely rude even if you try and prefix it with "I don't mean to be rude".

AbraKdabra 7 days ago | parent [-]

It's not rude if it's the truth.

Also he's a troll so...

knicholes 7 days ago | parent | prev [-]

I'm pretty successful with an above average IQ. It was very convincing, along with three other college grads (one a medical doctor).

AbraKdabra 6 days ago | parent [-]

Shit happens bro.

amatajohn 7 days ago | parent | prev | next [-]

the modern turing test:

am i getting scammed by a billionare or an AI billionaire?

UltraSane 7 days ago | parent | prev | next [-]

On the balance of probabilities it being a scam is vastly more likely than Elon actually wanting to contact you. Why would Elon need $15k in bitcoin?

It seems like money naturally flows from the gullible to the Machiavellian.

pennaMan 7 days ago | parent | prev | next [-]

hey, I got a bridge to sell you, was $20k but we can lower it to $15k if you pay in BTC

testplzignore 7 days ago | parent | next [-]

You're paying too much for your bridges man. Who's your bridge guy?

dkiebd 7 days ago | parent [-]

That wasn’t a bridge.

77pt77 7 days ago | parent | prev | next [-]

Was the bridge built by a genius like Elon though?

prawn 7 days ago | parent | prev [-]

He would sell tunnels, not bridges!

DonHopkins 7 days ago | parent | prev [-]

[flagged]

conradkay 7 days ago | parent | next [-]

I don't think he's the gullible one, check their bio ;)

knicholes 7 days ago | parent [-]

Unfortunately, this isn't one of my usual trollings. I've documented the scam on in this doc: https://docs.google.com/document/d/1lRbApgKT4U95zN0AYsPQqsLR...

conradkay 7 days ago | parent [-]

Ah that sucks. Having played runescape as a kid it feels obvious but that's a very sophisticated attack

lucasmullens 7 days ago | parent | prev [-]

Come on, don't be mean. Imagine saying this in person to someone who just told you they got scammed. "You're just extremely gullible" is just so mean...show some empathy.

DonHopkins 6 days ago | parent [-]

Anyone who trusts Musk enough to send him $15k doesn't deserve a bit of empathy.