Remix.run Logo
▲ borzi 6 hours ago

Great post, author clearly has a bright future. What I realized over the past years is that people that want to "think for themselves" were already, and probably always, in the minority. It's much easier to delegate how to react to a certain event or piece of information to someone else (news anchors, then influencers in last couple years, now increasingly AI I guess). I've certainly been guilty of this...

▲tegling 5 hours ago | parent | next [-]

Why must there be a dichotomy: "use AI/don't think for yourself", vs "don't use AI/think for yourself"?

I think we'll need to grow in our individual relationship with AI. Can't AI be that persuasive and contrarian, at times adversarial, friend? Someone you have to be somewhat wary of, but can provide very thoughtful, intelligent and challenging conversation? Such a "friend" obviously never replaces knowledge. If anything, you'll need to arm yourself with as much knowledge as possible to engage with that friend.

▲eloisius 5 hours ago | parent | next [-]

Skipping the “friend” criticism as you’ve already addressed it in sibling comments, but another reason among many that even trying to use it as an adversarial interlocutor is flawed thinking, is that even if you prompt it to debate you, you’re the one still prompting it to do that. It can never _mean_ to contradict your argument with its own unique viewpoint. It can only argue because you gave it that prompt. Ironically it’s still a sycophantic position.

▲tegling 4 hours ago | parent | next [-]

Appreciate your response! It was an honest question and this really helps. I think it explains my feeling of getting less "brainstorming" use of AI lately. We seem to be moving from dumber models that only provided a few different views (including stuff I didn't know) to sophisticated models that really "understands" what you want to hear and tailor for that. Any "knowledge" introduced to you in this process is only a side-effect/a strict non-goal. Rather, it wants you to feel engaged and happy with the response. Flipping this around: could it be helpful to develop some kind of "concensus models" filled with knowledge and with the sole purpose of teaching/providing you with that corpus? Or, to create some kind of mean-reversion effect of opinions at societal scale (rather than promoting "bubbles")? But at that point, we're very close to the subjects of propaganda and ideas of monoculture...

▲lproven 4 hours ago | parent [-]

> Appreciate your response! It was an honest question and this really helps. I

This reads increasingly like you're using a bot to write your answers.

▲tegling 4 hours ago | parent [-]

Or (sad, but true) learning manners from bots. Oh boy, where is this world heading?

▲nisegami 3 hours ago | parent [-]

I really struggle to see how someone "learning manners" could be construed as a bad thing? I feel like the world would be a lot kinder if everyone tried to be a bit more like the stochastic parrots tuned to be pleasant and polite.

▲rsfern 2 hours ago | parent [-]

I think the issue is that “bot manners” is often vapid filler. Like GP didn’t even ask a question so “it was an honest question that helps” doesn’t make sense in context. “Hey that was an insightful comment” would be a more engaged polite response IMO, “bot manners” kind of signals disengagement

▲intrikate 14 minutes ago | parent [-]

I had interpreted that statement as an indication that the original question posed ("Can't the AI be an adversarial friend in this way?") was honest, not that the response was an honest question.

▲nisegami 3 hours ago | parent | prev | next [-]

>It can never _mean_ to contradict your argument with its own unique viewpoint.

That just doesn't line up with my experience (depending on how strict you about about "unique"). I don't even ask it to debate me, but if I'm discussing a concept and make a claim about my own unique viewpoint it will readily point out things I may not be considering or things I appear to have misunderstood. It's shockingly effective at poking reasonable holes in things.

▲squidmaster 3 hours ago | parent | prev [-]

[dead]

▲bryanrasmussen 3 hours ago | parent | prev | next [-]

>Why must there be a dichotomy: "use AI/don't think for yourself", vs "don't use AI/think for yourself"?

because studies show that use of AI in subject areas of which one has expertise consistently decreases that expertise? As these subject areas are generally ones with intellectual requirements "use AI" = "Don't Think for Yourself", which underlines well known common sense aphorisms such as "use it or lose it", where the it is the expertise that one stops to use in favor of AI. You lose your ability to think for yourself in your field of expertise, but you gain the AI.

▲tegling 3 hours ago | parent | next [-]

That's kind of the whole question. You're correct, and we're likely heading towards a complete brain-drain if we don't adjust something. But those studies are descriptive. It's what it looks like now. I'm wondering what we can do in order to both have our cake and eat it. How to keep skill and knowledge mastery in humans AND use AI. And it's not helping that education/internships/junior positions are all pivoting for AI use rather than providing a proper learning environment with relevant friction, a curated corpus and time to mold our minds until we truly grok stuff ourselves.

▲audience_mem 3 hours ago | parent | prev [-]

do you think it's not possible for a person to be doing the thinking but AI to be doing the gruntwork? (eg coding)

▲bryanrasmussen an hour ago | parent | next [-]

if I thought that then it would be up to me to explain why the studies that show this is not the case are wrong, if you think that it is then it is up to you do to so and not to try to put the task on to me.

In other words, the data shows it is maybe not possible, you think it is, describe why the data is wrong and you are correct.

▲galactus 3 hours ago | parent | prev [-]

coding = thinking

▲zahlman an hour ago | parent [-]

I don't think this is actually true, or rather it's hiding something. We used to not be able to separate the gruntwork from thinking, because even at the level of typing out an individual line of code there's an instinctive review process. But this kind of "thought" is on a different level from the "thought" which led to starting the typing. Not even all the way up at the architecture level, but more the idea of just extracting the essential complexity of the task from the incidental complexity.

When I write code by hand and I feel confident about what I'm doing, the confidence comes from knowing that the extraction is generally already done. But I'll still find myself pausing and hesitating, checking for typos, making sure things correspond to their surrounding context… even after decades. It feels like "thinking" in the moment, but not so much when I reflect back on the nature of the task. AI seemingly is not limited by psychology, so it doesn't have these hangups (and of course it also just "types" far faster). It doesn't get an ego boost from being right the first time, and its "confidence" in the compiler, tools and tests is just not relevant.

▲lproven 4 hours ago | parent | prev | next [-]

> Can't AI be that persuasive and contrarian, at times adversarial, friend?

No. It generates text like that in its corpus. If there is a pattern that looks like the interaction you ask for, it will imitate it, but it can't be adversarial because it can't think. So you can always derail it.

▲zahlman an hour ago | parent [-]

Yes, you can always derail it. Just like how, in the pre-AI world (or ignoring AI), you could choose not to examine your beliefs. But now you have a tool that makes it easier, if you choose to try.

Given that the LLM has a goal to be sycophantic, by pretending to have different beliefs from your own, you may learn something about how the existing evidence is used to be sycophantic towards others, which is probably the best insight into why they hold those beliefs that you'd ever get. All you really need is the ability to represent those beliefs accurately. (And then, the "guardrails" on LLMs, in combination with biases in the training data, plus various effects in the training process, all unite to give the model a default "perspective" which may well differ from your own.)

▲lelanthran 4 hours ago | parent | prev | next [-]

> Why must there be a dichotomy: "use AI/don't think for yourself", vs "don't use AI/think for yourself"?

It doesn't have to be any extreme, although your next statement:

> I think we'll need to grow in our individual relationship with AI.

makes me think that anyone who develops a relationship with a tool is probably on one end of that extreme already.

▲tegling 4 hours ago | parent | next [-]

It was good to get a reality-check. I'll reconsider my approach to AI analogies as I realize anthropomorphizing is understood as problematic. Still, as you can see in one of my other comments, my key issue is that AI interaction interfaces are designed to mimic human interaction. That kind of side-steps our whole mental model of non-human things. I'm at loss here. Last, just want to clarify that by "relationship" I meant as in "the way in which two or more _things_ are connected", not as in human relationships.

▲jackling 2 hours ago | parent | prev | next [-]

Aren't you reading the comment a bit too literally? It's the same as saying "relationship with food". It's about how you interact with it as an entity versus some personal relationship.

▲DonHopkins 4 hours ago | parent | prev [-]

>makes me think that anyone who develops a relationship with a tool is probably on one end of that extreme already.

I have no regrets naming my cat Emacs.

▲noir_lord 5 hours ago | parent | prev | next [-]

It’s a matrix of numbers not a friend.

Strangely I’m not friends with my toaster either.

▲tegling 5 hours ago | parent | next [-]

Completely agree it's not human and anthropomorphizing might not be constructing. But I think we need to figure out _some_ kind of analogy that doesn't have us leave or brains in the drawer when interacting with it. Given ample sci-fi lore about all-powerful "Godlike" AI machines, playing the "machine" analogy might be equally problematic. If people think "well, obviously it's not a toaster, it's skynet", or some such.

▲delis-thumbs-7e 3 hours ago | parent | next [-]

We do create relationships ships with tools. I used to do plenty of manual labour in the past - railway and building construction, AV installations etc. and I have a degree in sculpture - and having a trustworthy Makita or even better a Hilti -driver as your companion felt like an assuring companion in the cold cruel world. Like one tool that is a bit special and has become almost a part of your arm. “There’s many like it, but this one is mine”. And of course probably everybody here has created a some sort of a loving friendship with their computer. Personally, I have a huge crush on Neovim at the moment. I don’t understand how I ever got anything done before I started using it.

I use Kimi K3 on OpenWebUI running on my desktop, which I can access via Tailscale on all my devices. Personally I really dislike using LLM’s to generate code - luckily I don’t work as dev - a mental block I need to solve at some point, but in researching and learning it is wonderful, when you use a system prompt to force it to search for info instead of hallucinating from training memory. It is just so much quicker than researching it with web searches yourself. To me it is a really sharp good knife that helps me to do what I want to do. Not a friend in a human sense, but a companion. Cowboy has a revolver, a samurai his sword… a hacker an nvim and llm, perhaps?

▲jurgenburgen 5 hours ago | parent | prev | next [-]

It’s an algorithm, a shiny hammer.

▲hardbass 4 hours ago | parent | next [-]

So are humans. Everything is an algorithm oer current physics knowledge. We can yave discussions on ai consciousness on various points but absurd statements like assuming humans or anything else are anything beyond molecules and algortihms is an absurdity of such a level I am not sure how someone can come up with it.

▲ThunderSizzle 3 hours ago | parent [-]

Humans have souls. There's a spiritual element we're not fully able to measure and see right now.

Perhaps we might in the future. The synapsis energy being visualized is probably the closest we are at right now, but there is a lot we don't know.

▲hardbass 3 hours ago | parent [-]

All well and good, but why is this belief in souls given any seriousness outside of fiction until that day? I will at least say your idea of a soul is computable and yes it makes it a better idea of souls than most religious versions of souls but also therefore, sorry to say, nothing that can't be implemented by other systems.

▲tegling 5 hours ago | parent | prev [-]

It's a motor-powered quadro-head hammer with unlimited nails (as long as you pour x% of world gdp into the hammer industry). It builds tree houses, actual houses, societies and food. Mostly by itself. It can also shoot you in the face. And make everyone fight over it. If used in production, great things can happen. Or some city gets destroyed. But, darn, isn't it SHINY!

▲ethnrob 5 hours ago | parent | prev [-]

Yes but that's an easy thing to say for people that already "think for themselves", this could be (already is, 4o) a dangerous precedent to set.

▲tigerlily 5 hours ago | parent | prev | next [-]

I'm a rubber duck being chewed by a dog on the internet, and my best friend is a matrix of numbers masquerading as a toaster.

▲drivebyhooting 5 hours ago | parent | prev | next [-]

And stranger yet, I’m not friends either any humans either. I’m not sure what happened after 15 years of working and being inundated with family responsibilities.

▲hardbass 3 hours ago | parent | prev | next [-]

Of course, and we are just a collection of dumb inert atoms.

▲exe34 4 hours ago | parent | prev [-]

Carbon chauvinism at its finest. Your "friends" are just meat bags with electro chemical neural networks.

▲hardbass 3 hours ago | parent | next [-]

Its frankly already absurd enough that religious beliefs are treated diplomatically, these days a lot of non religious people are also showing beliefs in souls. Why aren't statements about magic beyond atoms or algorithms in humans or any other physical system not laughed out the room by default is truly strange.

▲zahlman an hour ago | parent | prev [-]

> Carbon chauvinism

The fact that you ascribe meaning to this term and expect to be able to use it to win arguments already tells me that you are way outside the Overton window.

▲pandemic_region 5 hours ago | parent | prev [-]

I would label AI as friend in the same way I would label ads as informative.

▲tegling 5 hours ago | parent [-]

Agree it's not a friend. Hence, the quote marks on "friend" the second time. I'm just fumbling for analogies that advises for certain caution, highlight the value of one's own knowledge of actual facts, and acknowledges the interaction interface we currently have for AI: which is to mimic interaction with other humans. Any ideas how to capture those things in a mental image that we can relate to?

▲rskeens 3 hours ago | parent | prev | next [-]

Have heard multiple times in professional context it said that the need to think is no longer needed, almost as if it wasn't enjoyable.

In other cases it needed explanation as in the concept of thinking was unknown. Thinking in collaboration with ai is a super power and also thoroughly rewarding.

Maybe there is some kind of relation to having a guiding "inner voice" which some people report not having.

▲NalNezumi 3 hours ago | parent | prev | next [-]

I share your sentiment, but a recent episode made me doubt this position, and maybe you (or other HN readers) can enlighten me.

I don't want to out source thinking and therefore I'm very cautious with my AI use. This attitude caused a little quarrel with my partner, so I shared it with one of my close friend.

My close friend vehemently disagreed with me, he says AI is amazing and he have basically outsourced almost every thinking he does to it. Then he told me how it helped him:

One day he got a message about how his girlfriend was having a rough day at work. Late diagnosed ADHD as he is, he never really knew how to respond to this, so he just asked ChatGPT to write a reply to it (in his own tone). Later the day his girlfriend comes home, hugs and thank him that that compassionate message made her rough day feel much better. My friend doesn't tell her he used AI ofc, but internally thinks "wow is it this easy? Is all I needed to do, listen to the girl and validate her feelings?!" hes 35 btw.

He tells me that without AI he would've never realized this, and from his life decisions so far it's also clear that he never really had the patience to learn anything that is not of immediate interest to him. (and gf feeling seems to not have been)

I'm torn because I have to acknowledge that in the world the majority probably think like him; reading several books and listening to interviews and podcasts for 100+ hours about spousal communications after communication failure (like I did) is an outlier.

And this behavior is probably order of magnitude better than what he did before: getting relationship advice from Joe Rogan.

Edit: to clarify where I'm torn is not about my usebut the utility of it for cases like above. AI will probably (unless enshittification) HELP many people like my friend above, and probably prevent them from falling in conspiracy / online grifter scams because they now just prompt AI like "chat is this true?" and they're good at refuting bullshit. Essentially, we might have an antidote to Brandolini's law https://en.wikipedia.org/wiki/Brandolini%27s_law for the common man. I'm reserved because that's at the mercy of AI companies not enshittifying, and skill deterioration, and I have very little trust in that

▲larme 2 hours ago | parent | next [-]

I think this story can go 2 ways:

- Your friend get the positive feedback and begins to learn how to understand others better and give proper support to his family/friends (maybe with the help of AI)

- Or your friend begins to use AI to reply everything and becomes a hollow person

▲Planktonne 19 minutes ago | parent [-]

It sounds like he was already hollow, and AI is just letting him hide that better.

▲xerox13ster 11 minutes ago | parent | prev | next [-]

If he’s 35 and does not know how to validate somebody’s feelings and he listens to Joe Rogan, and he doesn’t have the patience to learn anything not immediately interesting to him:

that text was definitely not in his tone, and neither he, nor his girlfriend are intelligent and thinking enough to realize it. If they are, they are deluding themselves.

They are engaged in the facsimile of a relationship. She does not know him well enough to realize that he is putting zero effort into the emotional labor, and he has no business having a girlfriend that he is so pathologically disinterested in.

▲kouteiheika 3 hours ago | parent | prev | next [-]

> One day he got a message about how his girlfriend was having a rough day at work. [..] he just asked ChatGPT to write a reply to it (in his own tone). [..] Later the day his girlfriend comes home, hugs and thank him that that compassionate message made her rough day feel much better. My friend doesn't tell her he used AI ofc

To me this reads like something taken straight out of a South Park episode: https://en.wikipedia.org/wiki/Deep_Learning_(South_Park)

▲NalNezumi 2 hours ago | parent [-]

Maybe I should send it to him(or watch it with my partner)

▲delis-thumbs-7e 2 hours ago | parent | prev [-]

> hes 35 btw

And he will be 36 and single. Maybe 40, difficult to say. Y’know, men have pretended to listen women and fake validate their emotions, those dumb things only girls (yuck) have, probably since the times immemorial, and women have noticed this at some point and left.

Btw, I have ADHD, read constantly and listen podcasts most of my waking hours. Your friend’s behaviour has nothing to do with ADHD, more with sociopathy or other antisocial disorder. Perhaps you should find better people to hang out with. At which point will he start answering all of your messages with chatgpt? Or maybe he does already?

▲NalNezumi 2 hours ago | parent | next [-]

Maybe I should clarify that I don't blame all his behavior on ADHD and I wasn't trying to insinuate that but that combined with other traits, it is a contributing factor to "not bothering to learn anything that is not of interest to him(or deep enough)".

Because we don't message much, he doesn't use chatGPT on me that much.

Except one occasion when we first talked about if "catching up on sleep" was possible or not, and then later he sent me links to two academic papers claiming you can't. Now this is a guy that barely got through high school, so I knew since forever he never read those and 100% sure it's just something LLM linked to him that he just copy pasted.

Since I've done research in my life before, I criticized the papers based on the methodology and sample size (really bad papers), noting that the evidence if anything could also be interpreted in the opposite hypothesis. Noting that he might be right, but those two papers don't prove that.

I guess another point is also that he now have a "good sounding AI" that works well for romantic communication but for the above kind of issue will just throw you citation that he himself do not fully understand. But, then again, vast majority don't either. And no real damage was caused by him linking it (but also no lesson was learned)

▲Planktonne 18 minutes ago | parent [-]

> Maybe I should clarify that I don't blame all his behavior on ADHD and I wasn't trying to insinuate that but that combined with other traits, it is a contributing factor to "not bothering to learn anything that is not of interest to him(or deep enough)".

His partner should be of interest to him.

▲lenkite 2 hours ago | parent | prev | next [-]

> At which point will he start answering all of your messages with chatgpt? Or maybe he does already?

Aren't your friends already doing this ?

▲delis-thumbs-7e an hour ago | parent [-]

Mine? Absolutely not. What's the point? I can talk to a LLM myself if I want to.

▲jackling 13 minutes ago | parent | prev [-]

> Your friend’s behaviour has nothing to do with ADHD, more with sociopathy or other antisocial disorder. Perhaps you should find better people to hang out with.

Gotta love the armchair psychology. Recommending cutting off friends just because they used a tool to help them is a really strange take. Perhaps the commenter could just talk to his friend? Have a healthy disagreement and ask that he doesn't use ChatGPT to talk to him?

▲carlosjobim 2 hours ago | parent | prev | next [-]

It doesn't help that school has always been "Write an essay on the subject, but it must contain the same opinions as the textbook and reach the same conclusions as the textbook".

There are few human phenomena which have been more contrary to free thinking than schooling. You reap what you saw.

▲Silamoth 4 minutes ago | parent [-]

That doesn’t match my school experience. In fact, I had many cases where we were assigned to write persuasive or argumentative essays arguing for whichever position we wanted.

Of course, if your argument isn’t supported by the evidence (scientific, textual, or otherwise), then you won’t do well. But this is not a general description of school essays (although I have many other criticisms of school essays).

▲Propelloni 6 hours ago | parent | prev [-]

Yet never before there were so many people claiming to think for themselves, doing their own research, and forming insane opinions such as vaccination is harmful, or some other shit like chemtrails. Weird times.

▲snowram 6 hours ago | parent | next [-]

Unfortunately, many mistook being free thinking with being controversial. Common sense is often right no matter if it emanates from oneself or the outside world.

▲dwedge 5 hours ago | parent [-]

> many mistook being free thinking with being controversial

I may not be adding a very insightful comment here, but thanks for this. This one line really spoke to me and put into words something that I had in my head but didn't realise.

▲Negitivefrags 5 hours ago | parent | prev | next [-]

I find it very annoying that thinking for yourself associates you with these things.

I know the term “do your own research” is essentially burned, but the opposite opinion which seems to mostly hold sway “trust the experts” is just as distasteful.

▲birdland 5 hours ago | parent | next [-]

Well trusting experts is, generally speaking, a good heuristic, people will never have time to get acquainted with a sufficiently wide range of topics in order to not delegate to experts. Just has to not be a blind trust, and doing one's own research is all well and good but it requires being very critical about sources and the limits of one's own ability to evaluate them.

▲Cthulhu_ 3 hours ago | parent [-]

Thing is the "do your own research" people also "trust the experts", it's just that the experts they trust are populists spreading misinformation and fear about things like vaccines and (by extension) autism.

▲dc010 4 hours ago | parent | prev | next [-]

They are not opposites, if you are actually doing your own research you will find expert opinions, which you should usually trust. And having humility isn't distasteful.

▲nemo an hour ago | parent | prev [-]

Skepticism of experts virtually always makes a person more wrong, not less. Thinking for yourself should entail understanding expert opinion and why it is what it is, while ignoring the best informed people ensures ignorance.

▲plastic-enjoyer 6 hours ago | parent | prev | next [-]

I often think those people are born researchers who unfortunately lack the self-awareness to see their own biases, and the years of methodological training that teach you to check them. It's not that they don't think for themselves, they just can't critically self-assess. You have folks like flat earthers who are genuinely curious, don't take stuff for granted, and go as far as setting up experiments. That's the part I have deep admiration for. Sadly, they lack epistemic humility.

▲r_lee 6 hours ago | parent [-]

I would say with e.g. flat earthers it's likely the fact that their motivation is to prove the theory, not to conduct research in general, so the entire point of all that research is to prove something that can't be proven to be true

in many cases, the most underwhelming outcome i.e. that the consensus is right is a hard pill to swallow after years of trying to prove otherwise. denial is often an easier way out

▲ 6 hours ago | parent | prev | next [-]
[deleted]
▲flohofwoe 5 hours ago | parent | prev | next [-]

> "doing their own research"

...usually just means clicking on YouTube videos they get recommended by an algorithm that's optimized for engagement, not evoking critical thought. E.g. reinforcing instead of challenging personal opinions.

At least this specific sentence of "doing their own research" is a good signal that the person is a conspiracy theory idiot and can be ignored.

▲carlosjobim 2 hours ago | parent [-]

Why don't you ignore it then? Instead of reacting just because you saw some keywords?

▲1659447091 5 hours ago | parent | prev [-]

> people claiming to think for themselves, doing their own research, and forming insane opinions such as vaccination is harmful, or some other shit like chemtrails

Social contagion irony at it's finest

https://en.wikipedia.org/wiki/Social_contagion