Remix.run Logo
andrepd 14 hours ago

I've heard my grandma talk about Catholic saints and their powers with a not dissimilar kind of discourse.

TeMPOraL 13 hours ago | parent [-]

Point being?

Unlike Catholic saints, ChatGPT models actually exhibit these properties in directly observable and measurable way. I wrote how I decide which model to use for actual tasks, not which saint to pray to.

andrepd 11 hours ago | parent [-]

My grandma also uses saints for actual tasks (e.g. St Anthony for finding lost items), and they exibith those properties in observable ways (e.g. he found her sewing needles just last month). Perhaps the comparison is more appropriate than you realise.

> actually exhibit these properties in directly observable and measurable way

Well but do they? I don't mean your vibes, and I also don't mean cooked-up benchmarks. For example: https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...

thedevilslawyer 2 hours ago | parent | next [-]

If not users opinions, or objective benchmarks, then what? Sounds like you prefer closing your ears saying 'nananana...'

TeMPOraL 7 hours ago | parent | prev [-]

> Perhaps the comparison is more appropriate than you realise.

Or perhaps you stop being obtuse. There's no causal connection between "using saints for actual tasks" and the outcomes, which is why we call this religion. In contrast, you can see the cause-and-effect relationship directly and immediately with LLMs - all it takes is going to chatgpt.com or claude.ai, typing in a query, and observing the result.

> Well but do they? I don't mean your vibes, and I also don't mean cooked-up benchmarks.

Do read the study itself, specifically the parts where the authors spell out specifically what is or isn't being measured here.

andrepd 4 hours ago | parent [-]

It's really simple x) either the "observation" is just vibes, and then it's fundamentally the same as when Gran's knees get better after she asks Saint Euphemia, or it's actually a scientific observation, in which case please post! :)

You may not like but it's what it is.