Remix.run Logo
theptip 3 days ago

> But; they don't learn

If we took your brain and perfectly digitized it on read-only hardware, would you expect to still “think”?

Do amnesiacs who are incapable of laying down long-term memories not think?

I personally believe that memory formation and learning are one of the biggest cruces for general intelligence, but I can easily imagine thinking occurring without memory. (Yes, this is potentially ethically very worrying.)

lz400 3 days ago | parent | next [-]

>If we took your brain and perfectly digitized it on read-only hardware, would you expect to still “think”?

it wouldn't work probably, brains constantly alter themselves by forming new connections. Learning is inseparable from our intelligence.

WalterSear 3 days ago | parent [-]

Our intelligence, yes. But that doesn't establish it as essential for thought.

lz400 3 days ago | parent [-]

I mean, _we_ probably can't think with our wetware on a read-only substrate. It doesn't establish it as essential, just that the only sure example in nature of thought doesn't work that way.

theptip 2 days ago | parent [-]

Do you have any particular brain systems in mind that are essential for consciousness and also require mutable state?

lz400 2 days ago | parent [-]

I'm not an expert but as far I understand, plasticity is central to most complex operations of the brain and is likely to be involved in anything more complex than instinctive reactions. I'm happy to be corrected but it is my understanding that if you're thinking for a while on the same problem and establishing chains of reasoning, you are creating new connections and to me that means it's fundamental in the process of thinking.

theptip a day ago | parent [-]

Also not an expert :) I thought plasticity is an O(hours-days) learning mechanism. But I did some research and there is also Short Term Plasticity O(second) [1] which is a crucial part of working memory. We'd need that. But it seems it’s more of a volatile memory system, eg calcium ion depletion/saturation at the synapse, rather than a permanent wiring/potentiation change (please someone correct me if this isn’t right :) ).

So I guess I’d just clarify “read only” to be a little more specific - I think you could run multiple experiments where you vary the line of what’s modeled in volatile memory at runtime, and what’s immutable. I buy that you need to model STP for thought, but also suspect at this timescale you can keep everything slower immutable and keep the second-scale processes like thought working.

My original point still stands - your subjective experience in this scenario would be thought without long-term memory.

1: https://www.frontiersin.org/journals/computational-neuroscie...

lz400 20 hours ago | parent [-]

It would be funny if what you get from a read only human brain is a sort of memento guy who has no capacity to remember anything or follow a conversation... kind of like an LLM!

zeroonetwothree 3 days ago | parent | prev [-]

> If we took your brain and perfectly digitized it on read-only hardware, would you expect to still “think”?

Perhaps this is already known, but I would think there is a high chance that our brains require "write access" to function. That is, the very process of neural activity inherently makes modifications to the underlying structure.

theptip 2 days ago | parent | next [-]

> a high chance that our brains require "write access" to function

There are multiple learning mechanisms that happen on different time-frames, eg neural plasticity, hippocampus are both longer-term processes for memory consolidation. Whereas the content of “RAM” might be better modeled as a set of fast dynamic weights representing ions and neurotransmitter concentrations.

My hunch is that you could model the latter fast weights in volatile memory, but I wouldn’t count these as “modifying the structure”.

Do you have any particular systems in mind where you have reason to believe that permanent modification is required for brains to function?

xwolfi 3 days ago | parent | prev [-]

I wonder why we need to sleep so much though

theptip 2 days ago | parent | next [-]

Self-play for memory/skill consolidation, plus flushing out metabolites which can’t be cleaned while consciousness is online?

throwaway-0001 2 days ago | parent | prev [-]

Rebalancing weights?