Remix.run Logo
luxcem 18 hours ago

From [1],

  I asked a few students to read aloud the titles of some essays they’d submitted that morning.  
  For homework, I had asked them to use AI to propose a topic for the midterm essay. Most students had reported that the AI-generated essay topics were fine, even good. Some students said that they liked the AI’s topic more than their own human-generated topics. But the students hadn’t compared notes: only I had seen every single AI topic.  
  Here are some of the essay topics I had them read aloud:

  Navigating the Digital Age: How Technology Shapes Our Social Lives, Learning, and Well-Being  
  Navigating the Digital Age: A Personal Reflection on Technology  
  Navigating the Digital Age: A Personal and Peer Perspective on Technology’s Role in Our Lives  
  Navigating Connection: An Exploration of Personal Relationships with Technology  
  From Connection to Disconnection: How Technology Shapes Our Social Lives  
  From Connection to Distraction: How Technology Shapes Our Social and Academic Lives  
  From Connection to Distraction: Navigating a Love-Hate Relationship with Technology  
  Between Connection and Distraction: Navigating the Role of Technology in Our Lives  

  I expected them to laugh, but they sat in silence. When they did finally speak, I am happy to say that it bothered them. They didn’t like hearing how their AI-generated submissions, in which they’d clearly felt some personal stake, amounted to a big bowl of bland, flavorless word salad.

[1] https://lithub.com/what-happened-when-i-tried-to-replace-mys...
bootsmann 17 hours ago | parent | next [-]

This also happens with cover letters and CVs in recruiting now. Even if the HR person is not the brightest bulb, they figure out the MO after reading 5 cover letters in a row who all more or less tell the same story.

watwut 15 hours ago | parent [-]

CV were always BS tho - on both sides.

AlecSchueler 15 hours ago | parent [-]

Yeah I've been trying to write a short press bio for a musical project recently and it's next to impossible not to make it sound AI generated.

ultropolis 13 hours ago | parent [-]

I will tell you my cover letter secret*, which has gotten me a disproportionate number of interviews**:

Do NOT write a professional cover letter. Crack a joke. Use quirky language. Be overly familiar. A dash of TMI. Do NOT think about what you are going to say, just write a bunch of crazy-pants. Once your intro is too long, cut the fat. Now add professional stuff. You are not writing a cover letter, you are writing a caricature of a cover letter.

You just made the recruiter/HR/person doing interviews smile***. They remember your cover letter. In fact they repeat your objectively-unprofessional-yet-insightful joke to somebody else. You get the call. You are hired.

This will turn off some employers. You didn't want to work for them anyway.

* admittedly I have not sought work via resume in more than 15 years. ymmv

** Once a friend found a cover letter I had written in somebody's corp blog titled "Either the best or worst cover letter of all time" (or words to that effect). In it I had claimed that I could get the first 80% of their work done on schedule, but that the second 80% and third 80% would require unknown additional time. (note: I did not get the call)

*** unless they are using AI to read cover letters, but I repeat: you didn't want to work for them anyway.

raincole 17 hours ago | parent | prev | next [-]

If these topics are word salad, colleges might have been training word saucier chefs way before GPT-2 became a thing.

andrepd 16 hours ago | parent | next [-]

It's not just that it's word salad, it's also that it's exactly the same. There's a multi-trillion dollar attempt to replace your individuality with bland amorphous slop """content""". This doesn't bother you in the slightest?

pmg101 16 hours ago | parent | next [-]

I now have a visceral reaction to being told that I'm ABSOLUTELY RIGHT!, for example. It seemed an innocuous phrase before -- rather like em dashes -- but has now become grating and meaningless. Robotic and no longer human.

gilleain 15 hours ago | parent | next [-]

I'm launching a new service to tell people that they are absolutely, 100% wrong. That what they are considering is a terrible idea, has been done before, and will never work.

Possibly I can outsource the work to HN comments :)

pmg101 14 hours ago | parent [-]

This sounds like a terrible idea that has been done before and will never work.

AlecSchueler 15 hours ago | parent | prev [-]

You're exactly right, this really gets to the heart of the issue and demonstrates that you're already thinking like a linguist.

flir 16 hours ago | parent | prev | next [-]

For what most of us are using it for (generating code), that's not a bad outcome. This audience might have less of a problem with it than the general population.

Whether we have the discipline to limit our use of the tool to its strengths... well, I doubt it. Just look at how social media turned out.

(Idle thought: I wonder if a model fine-tuned on one specific author would give more "original" titles).

cantor_S_drug 16 hours ago | parent | prev [-]

This is the default setting. The true test would be if LLMs CAN'T produce distinct outputs. I think this problem can be solved by prompt engineering. Has anyone tried this with Kimi K2?

ares623 17 hours ago | parent | prev [-]

I had the exact same thought! Wow!

Now tell me, which one of us is redundant?

vintermann 15 hours ago | parent | prev | next [-]

So if I understand it correctly, they only asked for a midterm essay topic? It wasn't steered towards these topics in any way, for instance by asking for a midterm essay topic for (teacher)'s Technology and Society class?

astrobe_ 15 hours ago | parent | prev | next [-]

This was on HN's frontpage previously too; I immediately thought that this comic would say more or less the same thing. Perhaps both came from an AI? :D

But in another paragraph, the article says that the teacher and the students also failed to detect an AI-generated piece.

The ending of the comic is a bit anti-climatic (aside from the fact that one can see it coming), as similarities between creations are not uncommon. Endings, guitar riffs, styles being invented twice independently is not uncommon. For instance, the mystery genre was apparently created independently by Doyle and Poe (Poe, BTW, in Philosophy of composition [1], also claims that good authors start from the ending).

Two pieces being similar because they come from same AI versus because two authors were inspired and influenced by the same things and didn't know about each other's works, the difference is thin. An extrapolation of this topic is the sci-fi trope ( e.g. Beatless [2] ) about whether or not the emotions that an android simulates are real. But this is still sci-fi though, current AIs are good con artists at best.

[1] https://en.wikipedia.org/wiki/The_Philosophy_of_Composition

[2] https://en.wikipedia.org/wiki/Beatless

jovial_cavalier 16 hours ago | parent | prev | next [-]

I don't get this in the comic either: Why are you devastated that the idea you copied word-for-word is unoriginal? I don't understand what they expected.

jvanderbot 16 hours ago | parent [-]

If it seems obvious from where you are, then the target audience must not be where you are. In particular young students definitely lack context to critique and a big anonymous sampling like this is a great exercise.

jovial_cavalier 15 hours ago | parent [-]

I can understand not realizing that ChatGPT would give a bunch of similar sounding article titles to everyone, and I can understand being a little embarrassed that you didn't realize that. But why would you feel a "personal stake" in the output of an LLM? If you feel personal stake in something, you definitely should not be using an LLM for it.

jvanderbot 11 hours ago | parent | next [-]

Again, the statement "if you feel a personal stake in something, you definitely should not be using an LLM for it" is a learned response. To folks just forming their brains, LLMs are a natural extension of technology. Like PaulG said, his kid was unimpressed because "Of course the computer answers questions, that's what it does".

The subtlety of it, and the "obvious" limitations of it, are something we either know because we grew up watching tech over decades, or were just naturally cynical and mistrusting and guessed right this time. Hard earned wisdom or a broken clock being right this time, either way, that's not the default teenager.

ultropolis 13 hours ago | parent | prev [-]

Because you thought that you had collaborated with the LLM, not that it had fed you ideas. Have you and a partner both believed you contributed more than 50% of a project's work? Like that.

jdietrich 17 hours ago | parent | prev | next [-]

This isn't an inherent property of LLMs, it's something they have been specifically trained to do. The vast majority of users want safe, bland, derivative results for the vast majority of prompts. It isn't particularly difficult to coax an LLM into giving batshit insane responses, but that wouldn't be a sensible default for a chatbot.

tomashubelbauer 16 hours ago | parent | next [-]

I think moreso than the users it is the companies running the LLMs themselves who want the responses to be safe as to not jeopardize their brand.

flir 15 hours ago | parent | prev | next [-]

The very early results for "watercolour of X" were quite nice. Amateurish, loose, sloppy. Interesting. Today's are... well, every single one looks like it came off a chocolate box. There's definitely been a trend towards a corporate-friendly aesthetic. A narrowing.

Antibabelic 16 hours ago | parent | prev | next [-]

Are you sure? Yes, LLMs can be irrelevant and incoherent. But people seem to produce results that are more variable even when staying relevant and coherent (and "uncreative").

binary132 16 hours ago | parent | prev [-]

the business wants it this way, not the user.

amenhotep 17 hours ago | parent | prev [-]

That's a cute story. I asked ChatGPT to suggest "a topic for a midterm essay that addresses our relationship to technology", since that was all the information he gave us. It came up with:

The Double-Edged Sword: How Technology Both Enhances and Erodes Human Connection The Illusion of Control: How Technology Shapes Our Perception of Autonomy From Cyberspace to Real Space: The Impact of Virtual Reality on Identity and Human Experience Digital Detox: The Human Need for Technology-Free Spaces in an Always-Connected World Surveillance Society: How Technology Shapes Our Notions of Privacy and Freedom Technology and the Future of Work: Human Adaptation in the Age of Automation The Techno-Optimism Fallacy: Is Technology Really the Solution to Our Problems? The Digital Divide: How Access to Technology Shapes Social Inequality Humanizing Machines: Can Artificial Intelligence Ever Understand the Complexity of Human Emotion? The Ethics of Technological Advancements: Who Decides What Is ‘Ethically Acceptable’?

They're still pretty samey and sloppy, and the pattern of Punchy Title: Explanatory Caption is evident, so there's clearly some truth to it. But I wonder if he hasn't enhanced his results a little bit.

mcv 16 hours ago | parent | next [-]

I think he picked the most similar ones out of all the submissions from the entire class. But also, if you generate a list, maybe the AI ensures some diversity in that list, but if every student generates the same list, that still shows a lack of originality.

vidarh 15 hours ago | parent | prev | next [-]

Or the students have enhanced the results by picking the very samey outcomes out of a more varied pool of suggestions.

AlecSchueler 15 hours ago | parent | prev [-]

I think you're just proving the point with these examples.