Remix.run Logo
TeMPOraL 15 hours ago

> Perhaps the comparison is more appropriate than you realise.

Or perhaps you stop being obtuse. There's no causal connection between "using saints for actual tasks" and the outcomes, which is why we call this religion. In contrast, you can see the cause-and-effect relationship directly and immediately with LLMs - all it takes is going to chatgpt.com or claude.ai, typing in a query, and observing the result.

> Well but do they? I don't mean your vibes, and I also don't mean cooked-up benchmarks.

Do read the study itself, specifically the parts where the authors spell out specifically what is or isn't being measured here.

andrepd 12 hours ago | parent [-]

It's really simple x) either the "observation" is just vibes, and then it's fundamentally the same as when Gran's knees get better after she asks Saint Euphemia, or it's actually a scientific observation, in which case please post! :)

You may not like but it's what it is.

TeMPOraL 2 hours ago | parent [-]

I want to scream Jesus F Christ, but I guess that would be making your point for you :).

Still, it's not what you're saying. Vibes are present, too, but so are concrete effects like one-off utilities conjured in 2 minutes of prompting instead of 10 minutes of searching or 1 hour of coding, or research questions answered swiftly (and answers verified by me), that I normally wouldn't consider tackling due to up-front effort being greater than my discretionary time. And so on.

This is not vibes, but hard, empirical evidence, immediately retrievable as it just accumulates in the chat history, so I can always go back to check if I wasn't misremembering things.