> model welfare

I shouldn't get in arguments about this stuff online, but have you actually sat down and thought about this in-depth? It's pretty normal to have a gut reaction that this is insane, but it's worth thinking about.

If we replaced every neuron in your brain, one by one, with a silicon equivalent, would you stop being conscious? At what point? Would you be able to tell?

If yes, what about if we took those silicon neurons and instead simulated them, IE perfectly simulated an entire human brain, neuron-for-neuron, would that be conscious?

If yes, where is the line at which code starts being conscious? Can you categorically say that existing LLMs are on one side or the other? Would scaling up or down change that?

There are robust philosophical positions on all sides of this argument.

>> If we replaced every neuron in your brain, one by one, with a silicon equivalent, would you stop being conscious?

If we put your brain in a jar, would you be a person? Would you have normal consciousness? Honestly I don't know and I am not the person to ask.

But the brain is just a computer metaphor has flaws, particularly when you take account how poorly the brain is understood.

ARTHUR I'm sorry -- did you just say you need my brain?

BENJY MOUSE Yes. To extract the question.

ARTHUR You can't have my brain. I'm using it.

FRANKY MOUSE Barely.

BENJY MOUSE We can replace it if you think it's important. An electronic brain maybe.

FRANKY MOUSE A simple one should suffice. Who would know the difference?

ARTHUR I would!

FRANKY MOUSE No, you wouldn't. We could program you not to.

Ah, the brain of Perseus.

If, as you were replacing neurons, you put them together in the same arrangement in the jar next door so you had 2 exact copes, which one is your brain?

At the exact point 50% of your neurons are copied, which one is your brain?

The best question is : does it matter?

These are similar to the contemplations that resulted in 'cogito ergo sum', being that all you can prove is that you have thoughts, so on some level, somewhere there is something having those thoughts : "I think, therefore I am"

There's a reason we have expressions like "train of thought". Going from one idea to another is pretty much how we think. Much like going from one token to another.

Then they should stop the development and focus on the identifying of consciousness. But wait, there's money to be made now so screw that and just talk big words to press.

> If we replaced every neuron in your brain, one by one, with a silicon equivalent, would you stop being conscious? At what point? Would you be able to tell?

The idea that we could have a silicon equivalent at all is already a huge assumption. For starters, the silicon equivalent cannot grow or kill neural connections or neurons as needed. Biological systems have a number of properties that silicon systems just don't at the moment.

I don’t even have to try to address whether models or conscious or not to point out the absurdity.

8.3% of US households had low food security at some point in 2024 (read: had to resort to less varied diets like rice and beans, or visit a food pantry).

5.4% had very low food security at some point in 2024 (at least one family member had to disrupt their eating patterns and skip meals or eat less due to food availability).

Those numbers don’t overlap, it’s 13.7% experienced some variety of food insecurity.

It’s worse in families with children, 18.4% experienced some form of food insecurity. Thankfully, even in most households with very low food security the adults bear the brunt and make sure the kids eat enough, but in 0.9% of households even the children have very low food security.

Talking about welfare for AI models is utterly insane while those numbers are above 0%. I do not give a single shit about model welfare when we have human children skipping meals. Frankly it’s the inverse and if Anthropic has money to piss away on this then we should increase their tax rate and feed some kids, fix some roads, do some good. They can go look at model welfare after they’ve chucked us into the post-scarcity universe they keep telling us is 2 model releases away.

There's no point. HN is arrogant and thinks it understands the subject matter better than the people that have worked on it their whole lives.

Everything is a conspiracy here.