Remix.run Logo
Don't push AI down our throats(gpt3experiments.substack.com)
180 points by nutanc 3 hours ago | 72 comments
daft_pink 2 hours ago | parent | next [-]

The real creepy thing is the way they force you to give up your data with these products. If it were just useful add ons, it wouldn’t bother me, but the fact that Gemini requires you to turn activity history off for paid plans for the promise they won’t train on your data or allow a person to view your prompts is insanity. If you’re paying $20 for Pro or 249.99 for Ultra, you should be able to get activity history without training or review or storing your data for several years.

thomascgalvin 2 hours ago | parent [-]

I have a pixel watch, and my main use for it is setting reminders, like "reminder 3pm put the laundry in the dryer". It's worked fine since the day I bought it.

Last week, they pushed an update that broke all of the features on the watch unless I agreed to allow Google to train their AI on my content.

state_less 41 minutes ago | parent | next [-]

My Android phone comes hobbled unless I give it all my data to be used for training data (or whatever). I just asked, "Ok Google, play youtube music." And it responded with, "I cannot play music, including YouTube Music, as that tool is currently disabled based on your preferences. I can help you search for information about artists or songs on YouTube, though. By the way, to unlock the full functionality of all Apps, enable Gemini Apps Activity."

I'm new to Android, so maybe I can somehow still preserve some privacy and have basic voice commands, but from what I saw, it required me to enable Gemini Apps Activity with a wall of text I had to agree to in order to get a simple command to play some music to work.

quantified 35 minutes ago | parent | prev | next [-]

Did you agree, or did you give up your data?

Teever an hour ago | parent | prev | next [-]

International coordinated action by consumers taking a company to small claims court at the same time around the world to see redress about defective products would be an effective strategy.

Y_Y an hour ago | parent [-]

Are you proposing a "World Sue A Tech Giant Day"? A global bonanza of micro-litigation that bleeds AI-leviathans dry by a thousand cuts?

I'm in, but let's have it in October or something when I'm less busy.

verisimi an hour ago | parent | prev [-]

> I have a pixel watch

you rented/leased a watch for an undefined amount of time.

irusensei an hour ago | parent | prev | next [-]

Microsoft is all about this. You know how they also force stuff you don't want on the OS? Somewhere within Microsoft there might be a dashboard where they show their investors people are using Bing and Copilot. Borderline financial scam if you think about it.

cons0le an hour ago | parent | next [-]

Copy and paste is not working reliably in in windows anymore; coincidentally it's breaking at the same time Msoft is moving to replace all copy/paste with OCR only. It's garbage

connicpu 21 minutes ago | parent | prev [-]

That's why this was the year I finally dropped Windows and VSCode forever. Not that hard for me because all the games I play work flawlessly in Proton, and I already used Linux at work.

wasmainiac 2 hours ago | parent | prev | next [-]

> I will not allow AI to be pushed down my throat just to justify your bad investment.

Pretty much my sentiment too.

exsomet 2 hours ago | parent | next [-]

The neat thing about all this is that you don’t get a choice!

Your favorite services are adding “AI” features (and raising prices to boot), your data is being collected and analyzed (probably incorrectly) by AI tools, you are interacting with AI-generated responses on social media, viewing AI-generated images and videos, and reading articles generated by AI. Business leaders are making decisions about your job and your value using AI, and political leaders are making policy and military decisions based on AI output.

It’s happening, with you or to you.

wasmainiac a minute ago | parent | next [-]

I do have a choice, I just stop using the product. When messenger added AI assistants, I switched to WhatsApp. Now WhatsApp has one too, now I’m using Signal. Wife brought home a win11 laptop, didn’t like the cheeky AI integration, now it runs Linux.

hansvm 2 hours ago | parent | prev [-]

Reasonably far off topic:

Visa hasn't worked for online purchases for me for a few months, seemingly because of a rogue fraud-detection AI their customer service can't override.

Is there any chance that's just a poorly implemented traditional solution rather than feeding all my data into an LLM?

fragmede an hour ago | parent [-]

If by "traditional solution" you mean a bunch of data is fed into creating an ML model and then your individual transaction is fed into that, and it spits out a fraud score, then no, they'd not using LLMs, but at this high a level, what's the difference? If their ML model uses a transformers-based architecture vs not, what difference does it make?

esseph 18 minutes ago | parent [-]

One hallucinates data, one does not?

codaphiliac 2 hours ago | parent | prev [-]

almost the same as RTO mandates:

we’ll force you to come back to justify sunk money in office space.

mmastrac an hour ago | parent | prev | next [-]

Is it possible to permanently disable Gemini on Android? I keep getting it inserted into my messages and other places, and it's horrible to think that I'm one misclick away from turning it on.

Y_Y an hour ago | parent | next [-]

Sorry, you've irrevocably consented by touching a button that appeared above what you were trying to tap half a millisecond earlier.

withinboredom 24 minutes ago | parent [-]

That only happens with Apple, so it's fine.

ajkjk an hour ago | parent | prev [-]

My feeling is we need laws to stop it

rubyfan an hour ago | parent | next [-]

The industry agrees with you, hence the regulatory capture.

crazygringo an hour ago | parent | prev | next [-]

You don't like some features being added to products so you want laws against adding certain features?

I might not like a certain feature, but I'd dislike the government preventing companies from adding features a whole lot more. The thought of that terrifies me.

(To be clear, legitimate regulations around privacy, user data, anti-fraud, etc. are fine. But just because you find AI features to be something you don't... like? That's not a legitimate reason for government intervention.)

MangoToupe an hour ago | parent [-]

What is so terrifying about exerting democratic control over software critical to exist in society?

crazygringo 38 minutes ago | parent [-]

> over software critical to exist in society?

I don't know what that means grammatically.

But you could ask, what is so terrifying about exerting democratic control over people's free speech, over the political opinions they're allowed to express?

The answer is, because it infringes on freedom. As long as these AI features aren't harming anyone -- if your only complaint is you find their presence annoying, in a product you have a free choice in using or not using -- then there's no democratic justification for passing laws against them. Democratic rights take precedence.

collingreen 12 minutes ago | parent | next [-]

This is the argument against all customer protection as well as things like health codes, right?

Nobody is FORCING you to go to that restaurant so it's antidemocracy to take away their freedom to not wash their hands when they cook?

esseph 17 minutes ago | parent | prev [-]

Newsflash

If voters Democratically decide to do something, that's democracy at work.

Yizahi an hour ago | parent | prev [-]

Too big to fail now

Waterluvian 42 minutes ago | parent | prev | next [-]

VSCode feels like it’s in the “brand withdrawal” phase of its lifespan. I’ve turned off the sneakily named “Chat” and yet it still shows the chat sometimes when I toggle the bottom bar visibility.

> We will work with the creators, writers, and artists, instead of ripping off their life's work to feed the model.

I’m not sure I have an idea of what this might look like. Do they want money? What might that model look like? Do they want credit? How would that be handled? Do they want to be consulted? How does that get managed?

arealaccount 2 hours ago | parent | prev | next [-]

> We don't need to do it this quarter just because some startup has to do an earnings call.

What startups are doing earning calls?

collingreen 12 minutes ago | parent [-]

All the public ones?

tim333 25 minutes ago | parent | prev | next [-]

In addition to the annoyances mentioned, the pushing of AI may be leading to a massive waste of money and resources. I'm sure if, instead of AI being shoved in, want it or not, they said pay $1 if you want AI, the number of data centers needed would be reduced dramatically.

cnees an hour ago | parent | prev | next [-]

Amazon's Price History feature certainly doesn't need to open their AI assistant, but in addition to be graph I came for, I get a little summary of the graph. I really hope they aren't using an LLM for that when all it's doing is telling me it's the lowest price in 30 days.

rlt an hour ago | parent | prev | next [-]

I don’t we’re at the “companies bought too many GPUs” stage yet. My understanding is they still can’t get enough GPUs, or data centers to put them in, or power to run them. Most companies don’t even own them, they rent from the clouds.

We are, however, at the “we need an AI strategy” stage, so execs will throw anything and everything at the wall to see what sticks.

bdbdbdb 31 minutes ago | parent [-]

They can't get enough GPUs right now, with VCs pumping money into them, but that can very quickly turn into "we're out of money, what do we do with all these GPUs?"

Duanemclemore an hour ago | parent | prev | next [-]

The Copilot button that comes on new laptops is the Darkest Pattern I have ever seen. UI exploitation that has jumped the software / hardware gap.

A student will be showing me something on their laptop, their thumb accidentally grazes it because it's larger than the modifier keys and positioned so this happens as often as possible. The computer stops all other activity and shifts all focus to the Copilot window. Unprompted, the student always says something like "God, I hate that so much."

If it was so useful they wouldn't have to trick you into using it.

zahlman 33 minutes ago | parent | next [-]

> Unprompted, the student always says something like "God, I hate that so much."

... Dare I ask how Copilot typically responds to that? (They're doing voice detection now, right?)

> If it was so useful they wouldn't have to trick you into using it.

They delude themselves that they're doing no such thing. Of course the feature is so useful that you'd want to be able to access it as easily as possible in any context.

collingreen 9 minutes ago | parent [-]

And the telemetry doesn't lie! Look how many people are clicking that button! KPIs go brrrrrrr

politelemon 40 minutes ago | parent | prev [-]

I'm having a hard time believing any of this, and am tempted to think this might be in bad faith. It's true it's a bit ambitious on their part that they replaced the right side key, but it isn't larger than normal and it's not positioned any differently than normal keys. Working with hundreds of laptops and humans, several ham fisted, on a daily basis I've not seen this at all.

Further, a dark pattern is where you are led towards a specific outcome but are pulled insidiously towards another. This doesn't really fall into that definition.

btbuildem 12 minutes ago | parent | prev | next [-]

I mean, we're in the upslope stage of the hype/bubble cycle. Once this pops and 80% of invested people lose their shirts, the long-term adoption cycle will play out much more reasonably, more like OP wishes.

shmerl 2 hours ago | parent | prev | next [-]

As usual, those who spent too much money on it use it as a way to show their investors they didn't waste all that money and to get them to spend even more. That's why it's so messed up.

osigurdson 2 hours ago | parent | prev | next [-]

The worst usage of AI is “content dilution” where you take a few bullet points and generate 5 paragraphs of nauseating slop. These days, I would gladly take badly written content from humans filled with grammatical errors and spelling mistakes over that.

jjav 2 hours ago | parent [-]

> generate 5 paragraphs of nauseating slop

Which then nobody will ever read, they'll just copy it into the AI bot to summarize into a few bullet points.

The amount of waste is quite staggering in this back and forth game.

andrei_says_ an hour ago | parent | next [-]

> Which then nobody will ever read, they'll just copy it into the AI bot to summarize into a few bullet points.

Which more often than not will lose or distort the original intention behind the first 5 bullet points.

Which is why I avoid using LLMs for writing.

harvey9 an hour ago | parent | prev [-]

It's pretty awesome that we now have nondeterministic .Zip

collingreen 8 minutes ago | parent [-]

/dev/yolo

Isamu 2 hours ago | parent | prev | next [-]

The AI push is not just hype, it’s a scramble for cash. For now the only game plan is to scale up massively with a giant investment gamble, to try to get beyond the obvious limitations that threaten to burst the bubble.

Plus the general economy outlook is negative, AI is the bright spot. They are striving to keep growth up amid downward pressure.

ChrisMarshallNY 40 minutes ago | parent | prev | next [-]

This seems like a fairly reasoned screed. I can't find much to disagree with.

I am, personally, quite optimistic about the potential for "AI," but there's still plenty of warts.

Just a few minutes ago, I was going through a SwiftUI debugging session with ChatGPT. SwiftUI View problems are notoriously difficult to debug, and the LLM got to the "let's try circling twice widdershins" stage. At that point, I re-engaged my brain, and figured out a much simpler solution than the one proposed.

However, it gave me the necessary starting point to figure it out.

gosub100 2 hours ago | parent | prev | next [-]

If AI was as great as they pretend, there would be no need to force it on us.

AGI-slop 2 hours ago | parent [-]

Its the only game in town, and reasonably expected to be close to the last.

InexSquirrel 38 minutes ago | parent [-]

What do you mean by that?

nacozarina 2 hours ago | parent | prev | next [-]

assume it is being ‘done wrong’, not due to the usual trifecta of greed/evil/stupidity, but due to socio-economic pressure that demands this approach.

AI really needs R&D time, where we first figure out what it’s good for and how best to exploit it.

But R&D for SW is dead. Users proved to be super-resilient to buggy or mis-matched sw. They adapt. ‘Good-enough’ often doesn’t look it. Private equity sez throw EVERYTHING at the wall and chase what sticks…

snorbleck 2 hours ago | parent | prev | next [-]

yeah, we're f&%^ed

ponector 27 minutes ago | parent [-]

Fired?

zahlman an hour ago | parent | prev | next [-]

As I click into this thread from the front page, "Writing a Good Claude.md" appears immediately above it. Sigh.

mwkaufma 36 minutes ago | parent | prev | next [-]

>> It is time to do AI the right way.

Some "No True Scotsman"-flavored cope.

rvz 2 hours ago | parent | prev | next [-]

Ok fair enough, feel more of the AGI.

stego-tech 2 hours ago | parent | prev | next [-]

Replace AI with Blockchain. With cloud. With big data. With ERP. With service models. With basically almost any fad since virtualization. It’s the same thing: over-hyped tools with questionable value being shoe-horned into every possible orifice so the investors can make money.

I’m not opposed to any of the above, necessarily. I’ve just always been the type to want to adopt things as they are needed and bring demonstrable value to myself or my employer and not a moment before. That is the problem that capital has tried to solve through “founder mode” startups and exploitative business models: “It doesn’t matter whether you need it or not, what matters is that we’re forcing you to pay for it so we get our returns.”

manphone an hour ago | parent | next [-]

The difference is the level of investment and consumer application for each service - most customers would never be able to tell you what an erp is.

aurareturn an hour ago | parent | prev [-]

  Replace AI with Blockchain. With cloud. With big data. With ERP. With service models. With basically almost any fad since virtualization. It’s the same thing: over-hyped tools with questionable value being shoe-horned into every possible orifice so the investors can make money.
They said the exact same thing when electricity was invented too.

Gas companies said electricity was a fad. Some doctors said electric light harms the eyes. It's too expensive for practical use. Need too much infrastructure investment. AC will kill people with shocks. Electrification will destroy jobs, said gas lamp unions. It's unnatural, said some clergy. And on and on and on...

drivebyhooting 42 minutes ago | parent | next [-]

Electric light indeed harms the eyes.

exasperaited an hour ago | parent | prev | next [-]

This post is just one multipurpose category error.

XorNot 38 minutes ago | parent | prev [-]

What an utterly bizarre comparison.

Even the block chain comparison isn't valid because it didn't consist of an "AI" button getting crammed into every single product and website, turned into a popover etc.

65 an hour ago | parent | prev | next [-]

Oh how I'd like the AI bubble to pop already when ROIs don't justify the cost. I like AI for things like getting recommendations or classifying images. And yet execs feel the need to force every possible use case down our throats even if they don't make any sense or make quality worse.

E.g. Programming - and I do judge not only those who use AI to code but execs who force people to use AI to code. Sorry, I'd like to know how my code works. Sorry, you're not an efficient worker, you're just making yourself dumber and churning out garbage software. It will be a competitive advantage for me when slop programmers don't know how to do anything and I can actually solve problems. Silicon Valley tech utopians cannot convince me otherwise. I don't think poorly socialized dweebs know much about anything other than their AI girlfriends providing them with a simulation of what it feels like to not be lonely.

newsclues 2 hours ago | parent | prev | next [-]

If AI was amazing you wouldn’t need to push it, people would demand it!

You need to push slop, because people don’t really want it.

DaveZale 3 hours ago | parent | prev | next [-]

try watching a televised American football game. So many ads for AI. Of course ads appeal most to the gullible.

skeeter2020 2 hours ago | parent [-]

Have you seen the Workday ads featuring all the washed-up rock stars? They're pushing managing people AND AI agents - using AI. sigh...

zzzeek 2 hours ago | parent | prev | next [-]

> We will work with the creators, writers, and artists, instead of ripping off their life's work to feed the model.

i support this but the Smarter Than Me types say it's impossible. It's not possible to track down an adequate number of copyright holders, much less get their permission, much less afford to pay them, for the number of works required in order to get the LLM to achieve "liftoff".

I would think that as I use Claude for coding, it would work just as well if it didnt suck down the last three years of NYT articles as if it did. There's a vast amount of content that is in the public domain, and if you're ChatGPT you can make deals with a bunch of big publishers to get more modern content too. But that's my know-nothing take.

maybe the issue is more about the image content. Screw the image content (and definitely the music content, spotify pushing this slop is immensely offensive), pay the artists. My code OTOH is open source, MIT licensed. It's not art at all. Go get it (though throw me a few thousand bucks every year because you want to do the right thing).

FLT8 2 hours ago | parent | next [-]

It's not' impossible', it's economically unviable. There's a difference. We really should be mandating that companies that don't pay fair market prices for the data they use to train their models must open source everything as reparation to humanity.

bgwalter 2 hours ago | parent | prev [-]

It is not an axiom that LLMs even have the right to achieve "liftoff". They are obvious instruments of plagiarism that often just reorder sentences so as not to get caught. They can be forbidden.

If you don't mind the oligarchs stealing your code, that is your prerogative. Many other people do mind.

akomtu an hour ago | parent | prev | next [-]

AI can be thought of as a parasitic lifeform: it feeds on truth and excretes slop. We know AI is no good for us, but those pushing it have a nefarious plan: make people dependent on it, so we can't get rid of this parasite without destroying our society.

AGI-slop 2 hours ago | parent | prev [-]

AI will with certainty increase productivity of % and the rest will fall behind, perhaps dramatically. Effectiveness with AI can still be a grind, beyond simple prompting, we are getting lots of expensive AI tools heavily subsidized right now, that may not always be the case.