I think we'll start to see AI as any other tool that can atrophy your natural faculties. You can use a wheelchair to get everywhere, but your leg muscles will start to wither, but a wheeled vehicle for going longer distances is a genuinely useful tool.

Reaching for AI as a _substitute_ for thinking is bad, but reaching for it as a tool to assist thinking is good; you just need to be honest about whether it's your brain in the driver's seat or the chat bot.

> Reaching for AI as a _substitute_ for thinking is bad, but reaching for it as a tool to assist thinking is good; you just need to be honest about whether it's your brain in the driver's seat or the chat bot.

I think this is generally true, but human nature being what it is, the vast majority of people will use AI as a substitute for thinking rather than a tool to assist thinking. You can already see this from casual observation of today's AI users.

As I've grown older, I've noticed that more often than not, when someone says something to effect of, "Thing X can cause problems, but is great if used properly", you can be almost 100% certain that Thing X is going to cause very large problems and practically no one is going to use it correctly.

I don't think the "tool weakening" discourse is strong enough: it overlooks the aversarial nature of the modern internet. There are humans actively intending to weaken you for various reasons, either to sell you stuff or to weaken you ideologically by making you hate other humans such as in this comment https://news.ycombinator.com/item?id=45848215

See also https://news.ycombinator.com/item?id=45845772 "meta predicted 10% of revenue came from scams"

Yes, IMO this is going to start becoming visible sooner rather than later. College students that defer to ChatGPT to form arguments for them are going to graduate, sit for an in-person job interview and discover they haven't had to think fast, with their own brain, in years. It won't be pretty.

Steve Jobs "bicycle for the mind" analogy is more potent than I initially thought.

When got past the bicycle phase where we augment our body with technology but still leave room for our body to improve. We got into the automobile phase where only the goal matter and the body is not participating (and improving) anymore.

(well, except maybe for F1 which are bona fide athlete, but your average driver in a traffic jam is most certainly not a F1 driver)

> You can use a wheelchair to get everywhere, but your leg muscles will start to wither

Although it's not to the same degree of atrophy, I've been thinking of cars the same way. They're too easy to use once you have them, just press the pedal, so you stop walking and everything becomes a matter of driving distance, which makes it acceptable to distribute commercial activity in stupid little pockets of car destinations and avenues separated from each other by noise, pollution, and danger. People may not physically atrophy to the point of having no leg muscles, but their tolerance for walking a km becomes much more strained and their appreciation for investment in public transport lessens. They don't see or speak to people as much because they're always in their portable silo. You burn less calories, it's easier to gain weight, and people discount the value in having a gym within walking distance.

It's tough to reconcile it with being a functional tool, because although I could conceivably use it as one and buy one, I know that it can become an addiction.

there seems to be a parallel with the industrial revolution - being fit and having muscles used to be the norm when everyone worked the fields all day. but now that grocery stores and sedentary jobs have made exercise optional. so choosing to pursue fitness signals to others that one is disciplined, takes pride in their appearance, etc.

i can see the next couple generations of AI agents causing the same effect on reading, critical thinking, and intelligence in general. thinking is no longer necessary with AI agents, so maybe cultivating one's ability to think will become optional/personal pursuits which send similar signals.

>You can use a wheelchair to get everywhere, but your leg muscles will start to wither

I don't know if they still exists but there was a (Dutch, I think) company that makes non-electric lifts and tools for elderly people at home that require muscle effort from the people using them. Purely augmentative tools that don't work without input.

And that is how it needs to be. Framing this as choice is already wrong. Any tool that is agnostic or conducive to forfeiting agency will be used in wrong ways. It's not enough to make the healthy part optional, your brain will not be in the driver seat given how human beings work.

People in Japan are slim with no spending while people in the US remain obese while spending billions exactly because to the Japanese this isn't a choice, it's one the environment makes for them. If you rely on people "keeping themselves honest" you've already lost.

Ancient Egyptians on writing:

"For this invention will produce forgetfulness in the minds of those who learn to use it, because they will not practice their memory. Their trust in writing, produced by external characters which are no part of themselves, will discourage the use of their own memory within them."

https://www.anthologialitt.com/post/the-god-thoth-and-the-in...

This discourse is as old as humanity. Every tool makes us stronger but also paradoxically weaker.