Remix.run Logo
solid_fuel 3 hours ago

> We don’t need to fully understand the nature of consciousness to definitively say that certain things are not conscious, and conversational transcripts fall in that category.

Well said.

I think it is obvious and it has been obvious from the start that next token predictors are not conscious.

Of course the extremely predictable clapback from AI-psychosis enjoyers is typically "you're just a next token predictor too!" but that is so obviously incorrect and misanthropic that it can be dismissed out of hand and doesn't really merit much further consideration.

solidasparagus 2 hours ago | parent | next [-]

Independent of what you believe, I don't think this is the right way to approach thinking about it. It's basically emotion-oriented dismissal used as way to shortcut any substantial or nuanced discussion. It's like the opposite of intellectual curiosity.

drooby 2 hours ago | parent | prev | next [-]

I get the sense that he is misidentifying the potential locus of consciousness..

In the same way that the sound waves and facial expressions I produce are not conscious, the output json of an LLM is obviously not conscious either.

The locus of consciousness and subjective experience may be in the computer, either at inference time or training time..

skybrian 2 hours ago | parent [-]

If we ask "what is it conscious of when it writes something" then training time is irrelevant.

The software that does the inference is clearly just computer code.

What we're left with is a fictional character being briefly conscious while its dialog is being written, which is pretty absurd.

scarmig an hour ago | parent | prev | next [-]

"I feel very strongly that I'm unique, therefore you are wrong" is a bad argument.

Consciousness is an extremely confusing, ambiguous topic, and no one has a good way to establish it, or even define it. But it seems to demand people make very strong statements about what is and isn't conscious, entirely driven by convenience and emotionalism. (Curiously, very few people who think that bags of chemicals and action potentials give an entity a conscious soul are eager to extend that to other animals, with broadly similar hardware.)

ux266478 an hour ago | parent [-]

It's unfortunately the most common on this topic. I've been in the position of advocating for the existence of cognition and sentience in generally less-than-considered places, like plants, for a long time. I wish I could say LLMs expanding the domain has been interesting, but it's mostly just created more people spouting the same boring identity-protective reactionary pessimism.

wise0wl 2 hours ago | parent | prev | next [-]

People in this thread are trying to pick nits about you not defining consciousness, and yet they do not define it either. I think that something like consciousness needs to be approached experentially and not via definitions. Definitions necessarily confine and add borders around what something is and is not, but if there is something foundational to consciousness (as posited by some philosophers and physicists) then how could you realistically define something that is beyond the ability to describe and define?

Humans have been trying to define our experience and the nature of that experience throughout history, and often we end up using myth to point to the thing that we cannot describe in concrete terms. The process of experiencing that myth through rite and ritual in the Greek mystery traditions, or Christian mysticism, or Islamic Sufi dance and song, or Buddhist meditation all points to something that cannot really be reduced to description. I know that folks on here will balk at the idea that something that is experienced cannot be described, but honestly if we could accurately describe something in adequate terms that capture the whole of the thing wouldn't we have done so by now?

Maybe consciousness is best understood in the silence of merely experiencing it. Maybe we can't say that AI is conscious or not, but does that question really matter?

chinabot 2 hours ago | parent | prev | next [-]

I think its obvious that a few billion neurons connected together are not conscious either.. Yet!

measurablefunc an hour ago | parent [-]

> "Moreover, it must be confessed that perception and that which depends upon it are inexplicable on mechanical grounds, that is to say, by means of figures and motions. And supposing there were a machine, so constructed as to think, feel, and have perception, it might be conceived as increased in size, while keeping the same proportions, so that one might go into it as into a mill. That being so, we should, on examining its interior, find only parts which work one upon another, and never anything by which to explain a perception."

- Monadology, Section 17

Conscious self-awareness is neither scale invariant nor independent of substrate. Computational theories will never account for it b/c computational abstractions are both scale invariant & substrate independent.

adjejmxbdjdn 3 hours ago | parent | prev | next [-]

> misanthropic

Whether it’s misanthropic or not has no bearing on whether that’s true. That’s basically saying you don’t like a truth therefore anyone who claims that that truth is true is a bad person.

> so obviously incorrect

It should be easy enough to explain why that’s incorrect then

canelonesdeverd an hour ago | parent | next [-]

> It should be easy enough to explain why that’s incorrect then

I'd say people who have the lived experience of, well, living, are well aware that the brain is much more than just a token predictor.

arikrahman 3 hours ago | parent | prev [-]

Misanthropic has bearing, the company's name is Anthropic.

exe34 2 hours ago | parent | prev [-]

> so obviously incorrect and misanthropic that it can be dismissed out of hand

To be fair, that's the best thought terminating cliché, which saves you having to explain what you mean by consciousness.