Hogwash. We don't even have a consistent set of ethics on how to treat animals today, in the age of the Internet. We have people who refuse to eat meat because of how the animals are treated, and we have places where the locals make sport out of torturing animals to death, and indeed, our own recent history includes that as well (look up badgering).

Not to mention, the variation in treatment of homosexuals (including what constitutes homosexuality), people of different skin colors, handedness, how rape is treated in various cultures (often tied in with notions of property and ownership of all things), or even the various definitions of rape... The list goes on.

Maybe there's a core there in terms of how we treat a given in-group, but equally important is who belongs in that group and why, and that part seems to be tremendously flexible. Ditto for what constitutes acceptable treatment of outsiders.

I think its more accurate to say where you find consensus in morality, e.g. murder is wrong outside authorized violence (e.g. war or policing), you also find extensive selective pressure behind this behavior. It makes sense that all collective society cultures would outlaw murder; such a behavior is incompatible with collective living behavior whether you are in a cave or a modern skyscraper. Early societies have always been rejecting those alleles from their gene pool.

When you find shades of grey and great spectrum of opinions across time or space, its more that there isn't a strong selective pressure either way. How people are expected to dress is a good example of this. This has no real affect on society behavior or fecundity, so you see a spectrum of opinions that explain the differences between what you see in the middle east and a beach in brazil.

I did a philosophy minor, one class of which was the philosophy of ethics. There are many rules that definitely are not ethical today even if they were in the past so I don't think the point you're making really holds. Hammurabi (an eye for an eye) is probably one of the worst examples you could have cited.

Did the Golden Rule apply to women, gays, and slaves over the last 3000 years?

The definition of moral imperative is "an ethical principle, rule, or action that is strongly felt, urgent, and required because it is morally right." The Golden Rule is clearly not a strongly felt part of the human condition, or it would not be so ignored over ages and continents.

You take a class. Do you think coveting is immoral? Retributive justice? Human sacrifice?

Seriously. This idea that humanity has not spent millennia analyzing these concepts is pervasive in the modern world, and the only thing I can think to attribute it to is a lack of education. Not because I want to be insensitive, but because as soon as you start absorbing material and integrating the real timeline, you can't unsee it.

Is hammurabi's code moral? I don't know if I think that someone who takes out a person's eye deserves to have their own eye taken out also

It's not the case that all aspects are constant. There's some common themes across cultures and times, but it's definitely not the case that the morality of ancient people was the same as today.

LLMs are not the machines I am referring to, machine sentience, if achieved, will require a "state" and the ability to analyze, act on, and update it. LLMs are a small piece of what that machinery could look like but they are not really complex enough to get where we want to go on their own.

Another reason the big labs have not even talked about this lately because its obvious throwing more compute at LLMs wont go anywhere, the smaller silent players who are off the radar at the moment are having some interesting moments tho.

I'm not sure it doesn't change much, on a 50 year timeline maybe. But people were eating other humans and slaving away (making slaves of others that is) not too long ago, rape and pillage was acceptable, societies sacrificed children, it's changed quite a bit in 30 generations. Those past societies were all quite materially successful as well when you look at today's measure of"GDP" comparatively.

What will it look like in another 30 generations? It's honestly a fascinating question but I have no answer of course.

But this in itself is a tautology. It is because it is, without an analytical perspective on how it could be worse or better given different choices by the actors in a system.

Historically societies have collapsed all the time, so there are obviously societies that have made better choices than other ones.

I think neither the 'any set of morals is equally correct and workable' nor 'there is one fixed set of morality that is universal across time, place, and culture' is really defensible. It seems like morality is a set of ideas much like any other, and subject to selection pressure: some morals are more capable of surviving and propagating than others, and the common features we see across cultures are representative of that. But also we might expect that they shift with the structure of society and that has changed drastically because while human genetic evolution is progressing on a much longer timescale than recent history, memetic evolution is far faster (though for things like morality, still at generational timescales).

What is a human? There is the animal body part of us, the thing that wants to survive, the fight or flight. But there is also another mental part of us that shows different emergent behaviors than an animal. For example if I dropped you off in the woods as a very young child, you would be an animal, you would share very few modern 'thinking' traits with human society. That is human society and what it does emerges from the complexity of our interactions. It doesn't take much research to realize our interactions and behaviors have grown far more complex in the last 10,000 years. And then in the last 500 years there's been further acceleration with the industrial age and the rise of technology.

Even though humans haven't changed anatomically, culture and society has, which is what defines morality.