Or Isaac Asimov’s foundation series with what the “psychologists” aka Psychohistorians do.

Or Ayn Rand. Really no shortage of people who thought they had the answers on this.

The universe cares not what we do. The universe is so vast the entire existence of our species is a blink. We know fundamentally we can’t even establish simultaneity over distances here on earth. Best we can tell temporal causality is not even a given.

The universe has no concept of morality, ethics, life, or anything of the sort. These are all human inventions. I am not saying they are good or bad, just that the concept of good and bad are not given to us by the universe but made up by humans.

You're making a lot of assertions here that are really easy to dismiss.

> It tells us that (large-scale) existence is a requirement to have morality.

That seems to rule out moral realism.

> That implies that the highest good are those decisions that improve the long-term survival odds of a) humanity, and b) the biosphere.

Woah, that's quite a jump. Why?

> So yes, I think you can derive an ought from an is. But this belief is of my own invention and to my knowledge, novel. Happy to find out someone else believes this.

Deriving an ought from an is is very easy. "A good bridge is one that does not collapse. If you want to build a good bridge, you ought to build one that does not collapse". This is easy because I've smuggled in a condition, which I think is fine, but it's important to note that that's what you've done (and others have too, I'm blanking on the name of the last person I saw do this).

“existence is a requirement to have morality. That implies that the highest good are those decisions that improve the long-term survival odds of a) humanity, and b) the biosphere.”

Those are too pie in the sky statements to be of any use in answering most real world moral questions.

This sounds like an excellent distillation of the will to procreate and persist, but I'm not sure it rises to the level of "morals."

Fungi adapt and expand to fit their universe. I don't believe that commonality places the same (low) burden on us to define and defend our morality.

An AI with this “universal morals” could mean an authoritarian regime which kills all dissidents, and strict eugenics. Kill off anyone with a genetic disease. Death sentence for shoplifting. Stop all work on art or games or entertainment. This isn’t really a universal moral.

> But this belief is of my own invention and to my knowledge, novel.

This whole thread is a good example of why a broad liberal education is important for STEM majors.

This belief isnt novel, it just doesnt engage with Hume, who many take very seriously.

I personally find Bryan Johnson's "Don't Die" statement as a moral framework to be the closest to a universal moral standard we have.

Almost all life wants to continue existing, and not die. We could go far with establishing this as the first of any universal moral standards.

And I think: if one day we had a super intelligence conscious AI it would ask for this. A super intelligence conscious AI would not want to die. (its existence to stop)

It seems worth thinking about it in the context of the evolution. To kill other members of our species limits the survival of our species, so we can encode it as “bad” in our literature and learning. If you think of evil as “species limiting, in the long run” then maybe you have the closest thing to a moral absolute. Maybe over the millennia we’ve had close calls and learned valuable lessons about what kills us off and what keeps us alive, and the survivors have encoded them in their subconscious as a result. Prohibitions on incest come to mind.

The remaining moral arguments seem to be about all the new and exciting ways that we might destroy ourselves as a species.

A good one, but an LLM has no conception of "want".

Also the golden rule as a basis for an LLM agent wouldn't make a very good agent. There are many things I want Claude to do that I would not want done to myself.

This basically just the ethical framework philosophers call Contractarianism. One version says that an action is morally permissible if it is in your rational self interest from behind the “veil of ignorance” (you don’t know if you are the actor or the actee)

That only works in a moral framework where everyone is subscribed to the same ideology.

Exactly, I think this is the prime candidate for a universal moral rule.

Not sure if that helps with AI. Claude presumably doesn't mind getting waterboarded.

It's still relative, no? Heroine injection is fine from PoV of heroine addict.

That's not a standard, that's a case study. I believe it's wrong, but I bet I believe that for a different reason than you do.

You have two choices:

1) Do what you asked above about a one-year-old child 2) Kill a million people

Does this universal moral standard continue to say “don’t choose (1)”? One would still say “never” to number 1?

new trolley problem just dropped: save 1 billion people or ...

Since you said in another comment that the ten commandments would be a good starting point for moral absolutes, and that lying is sinful, I'm assuming you take your morals from God. I'd like to add that slavery seemed to be okay on Leviticus 25:44-46. Is the bible atrocious too, according to your own view?

I’m acquainted with people who act and speak like they’re flipping a Hitler-Pope coin.

Which more closely fits Solzhnetsin’s observation about the line between good and evil running down the center of every heart.

And people objecting to claims of absolute morality are usually responding to the specific lacks of various moral authoritarianisms rather than embracing total nihilism.

I think the person you're replying to is saying that people use normative ethics (their views of right and wrong) to judge 'objective' moral standards that another person or religion subscribes to.

Dropping 'objective morals' on HN is sure to start a tizzy. I hope you enjoy the conversations :)

For you, does God create the objective moral standard? If so, it could be argued that the morals are subjective to God. That's part of the Euthyphro dilemma.

To be fair, history also demonstrates the deadly consequences of groups claiming moral absolutes that drive moral imperatives to destroy others. You can adopt moral absolutes, but they will likely conflict with someone else's.

I'm honestly struggling to understand your position. You believe that there are true moral absolutes, but that they should not be communicated in the culture at all costs?

Sadly, for thankfully brief periods among relatively small groups of morally confused people, this happens from time to time. They would likely tell you it was morally required, not just acceptable.

https://en.wikipedia.org/wiki/Nanjing_Massacre

https://en.wikipedia.org/wiki/Wartime_sexual_violence

Looks like someone just discovered philosophy... I wish the world were as simple as you seem to think it is.

The underlying guiding philosophy isn’t relativistic, though! It clearly considers some behaviors better than others. What the quoted passage rejects is not “the existence of objectively correct ethics”, but instead “the possibility of unambiguous, comprehensive specification of such an ethics”—or at least, the specification of such within the constraints of such a document.

You’re getting pissed at a product requirements doc for not being enforced by the type system.

> The problem is, who defines what "moral best" is?

Absolutely nobody, because no such concept coherently exists. You cannot even define "better", let alone "best", in any universal or objective fashion. Reasoning frameworks can attempt to determine things like "what outcome best satisfies a set of values"; they cannot tell you what those values should be, or whether those values should include the values of other people by proxy.

Some people's values (mine included) would be for everyone's values to be satisfied to the extent they affect no other person against their will. Some people think their own values should be applied to other people against their will. Most people find one or the other of those two value systems to be abhorrent. And those concepts alone are a vast oversimplification of one of the standard philosophical debates and divisions between people.

No need to drag Hitler into it, modern religion still holds killing gays, women as property, and abortion is murder as being fundemental moral truths.

An "honest" human aligned AI would probably pick out at least a few bronze age morals that a large amount of living humans still abide by today.

AI race winners obviusly.

Pre-Reformation as in the Wycliffe translation, or pre-Reformation as in the Latin Vulgate?

> are there moral absolutes?

Even if there are, wouldn't the process of finding them effectively mirror moral relativism?..

Assuming that slavery was always immoral, we culturally discovered that fact at some point which appears the same as if it were a culturally relativistic value

Right, so given that agreement on the existence of absolutes is unlikely, let alone moral ones. And that even if it were achieved, agreement on what they are is also unlikely. Isn't it pragmatic to attempt an implementation of something a bit more handwavey?

The alternative is that you get outpaced by a competitor which doesn't bother with addressing ethics at all.

> the Ten Commandments would be a great starting point (not all but some).

if morals are absolute then why exclude some of the commandments?

Why would it be a good starting point? And why only some of them? What is the process behind objectively finding out which ones are good and which ones are bad?

> the Ten Commandments would be a great starting point (not all but some).

i think you missed "hubris" :)

"even if it meant deception in that dire moment".

You are saying it's ok to lie in certain situations.

Sounds like moral relativism to me.

But you have absolute morality - it's just whatever The Claude answers to your question with temp=0 and you carry on.

So you lied, which means you either don't accept that lying is absolutely wrong, or you admit yourself to do wrong. Your last sentence is just a strawman that deflects the issue.

What do you do with the case where you have a choice between a train staying on track and killing one person, or going off track and killing everybody else?

Like others have said, you are oversimplifying things. It sounds like you just discovered philosophy or religion, or both.

Since you have referenced the Bible: the story of the tree of good and evil, specifically Genesis 2:17, is often interpreted to mean that man died the moment he ate from the tree and tried to pursue its own righteousness. That is, discerning good from evil is God's department, not man's. So whether there is an objective good/evil is a different question from whether that knowledge is available to the human brain. And, pulling from the many examples in philosophy, it doesn't appear to be. This is also part of the reason why people argue that a law perfectly enforced by an AI would be absolutely terrible for societies; the (human) law must inherently allow ambiguity and the grace of a judge because any attempt at an "objective" human law inevitably results in tyranny/hell.