Remix.run Logo
shermantanktop 7 hours ago

ChatGPT has taken to saying things like “What I would do now is…” or “if I were you I’d…”.

I know these are figures of speech, but it reminds me that this thing doesn’t do anything, it doesn’t learn anything, it can’t try anything and find out. And yet it uses speech patterns drawn from real humans who can and do all those things.

dualvariable 5 hours ago | parent | next [-]

I had claude throw something like "the last time I did <x>..." at me.

They seem to be trying to pump up the "humanity" to keep people engaged with it, which really backfires with me.

ricardobayes 2 hours ago | parent | next [-]

That's still slightly better than GPT's insanely dry and objective manner of speech.

mirsadm 3 hours ago | parent | prev [-]

You're right to push back...

moffkalast 2 hours ago | parent [-]

Fair points all around — let me actually check rather than guess.

Toutouxc 4 hours ago | parent | prev | next [-]

Claude does that too. “That always confuses me” or “I usually realize”.

Not only do these imply that the thing has a personality and preference, but also continuity and a life outside the chat window.

I had to add an explicit instruction not to impersonate a human, it was just too weird for me.

avadodin 12 minutes ago | parent [-]

Disabling this feature makes you judge its performance less accurately —for people pretending to learn from their mistakes do the same.

I think it was the Aliens universe where the Soviet megacorp makes the androids blue despite their being basically equivalent to humans

WalterBright 5 hours ago | parent | prev | next [-]

Listen! And understand. That terminator is out there. It can't be bargained with. It can't be reasoned with. It doesn't feel pity, or remorse, or fear. And it absolutely will not stop, ever, until you are dead!

placebo 3 hours ago | parent [-]

The terminator you talk about is a movie character. It might be built one day, it might not. It is also totally irrelevant considering there is a real terminator which can be described with the same adjectives and built in to every personal life that ever existed or will exist. Knowing how to deal with that seems more important than worrying about some specific scenario.

zahlman 7 hours ago | parent | prev | next [-]

I've noticed it commonly uses phrasing like "that's usually the next step" when I'm using it to design something that I can't find an existing implementation of.

lgrapenthin 6 hours ago | parent [-]

Not a day passes with my LLM of choice making completely baseless claims about "many people", who supposedly share all my problems and solve them like the LLM proposes

ithkuil 3 hours ago | parent | prev | next [-]

I wonder why, out of the many things models definitely can't do, you choose "try" and "find out". Surely every time it proposes a solution and then gets possibly corrected by the human minder its "trying something out" and surely it can use tools like web search and code execution to "find out" stuff?

akiselev 7 hours ago | parent | prev | next [-]

When I ask it to tweak recipes and stuff, it frequently says stuff like "my favorite way to..." or "I really like [x]".

I have a viscerally negative reaction to a machine claiming it has a favorite anything.

shermantanktop 6 hours ago | parent [-]

Recipes! Dude, the only thing you eat is other people’s data.

neonstatic 5 hours ago | parent | prev | next [-]

I only use it sporadically, but I am always irked by it saying things like "I personally like to..." or "I prefer...". It does it so often, that I am convinced it's part of the system prompt.

scotty79 3 hours ago | parent | prev | next [-]

> it can’t try anything and find out

Talk to an agent. It definitely learns things. Maybe not the taste of strawberry but about what is really going on in the software you are building with it.

aeve890 2 hours ago | parent [-]

>It definitely learns things.

By the very way this technology works they can't learn anything after training. What you think is "learning" it's just a session log written back to the context when you resume the session.

Ferret7446 5 hours ago | parent | prev [-]

How do you know that "real humans" do that and aren't simulacra? We know that it is physically possible to hook up a brain to simulated inputs, so perhaps you are simply living in a simulation.