Remix.run Logo
bccdee 2 hours ago

And then how do you uncover bias in your chatbot? Do you ask it to analyze its own analysis? For that matter, what about the bias in your prompt, which LLMs tend to accept uncritically? Do your own preconceived opinions bias you against the argument made in the article? Are you using a chatbot to think critically about the article, or to avoid thinking critically about your own beliefs?

> At the same time, 79 percent of those surveyed by Gallup “expressed concern that AI makes people lazier,” and 65 percent said that using chatbots “promotes instant gratification, not real understanding” and prevents people from engaging with ideas in a critical or meaningful way.

Perhaps you should take a cue from these surveyees and do your own thinking.

not_wyoming 2 hours ago | parent [-]

I actually did this - I plugged The Verge article into Claude and got the following critique of what biases are there:

> The article accurately cites real Gallup data but selectively omits findings that complicate its "backlash" narrative — most notably that curiosity is Gen Z's single most common emotion toward AI, and that daily users remain substantially more hopeful and excited than the aggregate figures suggest. The 79% "laziness" concern and declining hope figures are presented as evidence of generational rejection, when the researchers themselves describe what they found as "deep ambivalence." *In short, the article uses real numbers to tell a cleaner, more oppositional story than the underlying polling actually supports.*

Then I then put that Claude critique back into Claude and asked it to analyze the critique for bias and agendas and got this:

> The critique accurately catches real flaws in The Verge article — particularly the omission of "curiosity" as Gen Z's top emotion and the failure to distinguish between heavy users (who are more positive) and non-users (who drive most of the negativity). However, *the critique has its own directional bias, consistently framing every correction in ways that soften the negative trend, while ignoring data that cuts the other way — like the sharp positivity decline even among daily users, and the near-majority of Gen Z workers who see AI as a net negative in the workplace. *Both pieces are selectively using the same real data to tell opposite stories; the Gallup findings themselves are more nuanced and more negative than the critique allows.*

So according to Claude, Claude is biased in how it describes The Verge as biased.

LLMs are breakthrough technologies. The AI products we have today are SaaS products built by companies doing everything they can to find people who will pay for them. Very, very different things.

sailfast an hour ago | parent | next [-]

> LLMs are breakthrough technologies. The AI products we have today are SaaS products built by companies doing everything they can to find people who will pay for them. Very, very different things.

THIS. ALL. DAY.

catcowcostume an hour ago | parent | prev [-]

So basically sycophantic LLM behavior. Nothing new then