Remix.run Logo
atomicnumber3 6 hours ago

Yes, somehow. I have been dealing with an awful lot of people who basically have what are theoretically logic degrees who suddenly just take LLMs at face value, or quote them to me like that actually means anything. People I formerly thought were sane.

sodapopcan 6 hours ago | parent | next [-]

I don't mean to put words in your mouth but from what I've seen, in person but mostly online, but the "problem" (and I put that in quotes because I don't even know what to call it... it seems deeper than a mere "problem") is that they quote them as if they are autonomous, sentient beings.

BobbyTables2 4 hours ago | parent | next [-]

The problem is that LLM output looks like a human conversation. People believe it.

Which is more believable?

“The sky is filled with a downpour of squealing pigs. Would you like me to suggest the best type of umbrella?”

“Sky pigs squealing”

sodapopcan 4 hours ago | parent | next [-]

People just don't like to be played for fools. Perhaps us giving into this is progress? I'd give a big ol' "fuck you" to anyone who claims it is, but I'm also pretty old.

yammosk 4 hours ago | parent | prev [-]

I am not sure I would even say "believe", I would think of it more as short-circuiting our critical thinking. I think it taps into something at the core of our tribal instincts. It was famously present in even basic systems like Eliza. And it's not just machines... The same tricks are used by conmen, politicians, and psychopaths, which is more negative than I intend. Even with good intentions and positive outcomes, I feel we need to remember that we drive it, not the other way around.

al_borland 5 hours ago | parent | prev [-]

Some of this might depend on the source.

I’ve seen some people quote AI like you’re saying. However, when I preface something with “ChatGPT said…”, my intention is to convey to the listener that they should take it with a grain of salt, as it might be completely bull shit. I suppose I should consider who I’m talking to when I make that assumption.

jazzyjackson 4 hours ago | parent [-]

it’s a slightly orthogonal problem to using the active voice of “XYZ says…”, it’s treating the text continuation engine as an “other” that may know better than they do, playing into sci fi conceptions of AI having its personal positronic brain or whatever, having its own ideas and deciding to carve a horse out of driftwood.

It’s not quite anthropomorphizing either that’s the issue, need a word for “treating it as tho it were a machine conscious that exists alongside humanity*”, how does cyborgropomorphizing sound

   * and not merely a markov chain running in Sam Altman’s closet
ACow_Adonis 5 hours ago | parent | prev | next [-]

Surely the correct conclusion is to question the value/veracity of those degree issuing institutions and rituals?

And if you previously were unaware of the insanity and irrationality passing under the surface of such human activity, I guess it can come as a bit of a shock :)

heliumtera 5 hours ago | parent | prev | next [-]

>take llms at face value

It happened with science, politics, traditional media, history books, "good engineering practices" applied to IT, OOP,tdd,DDD,server side rendering, containerization... Literally every bullshit shilled to the moon is accepted without second guessing and you would be without a job, in an asylum, for questioning 2 of them in a row.

Why is it different now? EVERYTHING is bullshit, only attention matters. And craftsmanship.

soopypoos 5 hours ago | parent [-]

and ruthless efficiency

cindyllm 5 hours ago | parent [-]

[dead]

cookiengineer 4 hours ago | parent | prev [-]

I don't think this has anything to do with sanity. This has to do with people for seeking self confirmation instead ot disproval.

For pretty much everything there is a conspiracy theory out there claiming the opposite, and these types usually started out searching the internet for someone else who believes the same that they did at the time.

But, as we all know, this technique will eventually lead to overfitting. And that's what those types of people have done to themselves.

Well, and as lack of education is the weakness of democracy, there's a lot of interested parties out there that invest money in these types of conspiracy websites. Even more so after LLMs.

Whoever controls the news controls the perpetual presence, where everything is independent of the forgotten history.