Remix.run Logo
lins1909 3 days ago

Uhm, I'm very confused by the last part of your comment. You put it into an LLM to...understand the tone? Is that supposed to convince me of something?

ToValueFunfetti 3 days ago | parent | next [-]

They phrased it poorly, but from context it seems clear they intend the LLM as a less biased third-party measure of the tone which agrees with their own assessment.

zeratax 3 days ago | parent [-]

which they very much are not

ToValueFunfetti 3 days ago | parent [-]

Less biased? Maybe on political questions, etc, but this is a classic NLP task and I expect LLMs to be very reliable here

dgellow 3 days ago | parent [-]

LLMs are predictive engines based on Reddit data, what they generate is very far from neutral

lifthrasiir 3 days ago | parent | prev | next [-]

Reality check. The confirmation that the author is not alone in having this particular feeling by using an LLM as a proxy.

lkey 3 days ago | parent [-]

Using an LLM as a proxy for an 'unbiased' source of personal confirmation bias is perhaps the most common 'use-case' for an LLM.

QuadmasterXLII 3 days ago | parent | prev | next [-]

I guess they use an LLM to work out the tone of prose they read. These are strange times.

uludag 3 days ago | parent | prev [-]

Very weird indeed. People must not realize that you can completely change the response you get back from an LLM by how you ask questions. Any bias can implicitly be implanted in the question you ask and drastically modify the response. This is what I got Gemini to say about the article:

  The author’s tone in this piece can be described as brutally candid, deeply relieved, and unapologetically sarcastic.
very different from "The overall tone is deeply personal, cathartic, biting, and polemical, with flashes of humor and a deliberate attempt to soften the ending."
dofm 3 days ago | parent | next [-]

Not very different, mind you.

I don't really agree with using LLMs to do this but it correctly identified the attempt to soften the ending, which is to my mind significant in the whole piece; this person wants to repeat and frame unkind things he's heard, say unkind things, and then assert that he wasn't doing either.

lifthrasiir 3 days ago | parent | prev | next [-]

Personally I don't think that matters, because the article is problematic enough when it can be read like ad hominem. Assuming that the question was phrased reasonably neutrally (but not necessarily free of hidden biases), the fact that LLM concluded so is an enough evidence here. Also as a non-LLM data point, I felt roughly same (especially the "softening" bit).

alienbaby 3 days ago | parent | prev [-]

this is what worries me. I have friends that love what AI tells them about their personal pet 'thing' and how awesome it is. Yet not one of them has even tried once to get the AI to criticise it's own answers, and hence learn that you can trivially get an AI to make a convincing-_sounding case for any point of view.

I tell them to try, and they laugh at me as they roll their eyes and waffle on about 'tricking' the AI like its some kind of hacking.