Remix.run Logo
luciana1u 2 hours ago

the natural endpoint of this trend is a system prompt that just says "you know what to do" and the model actually does

2 hours ago | parent | next [-]
[deleted]
cmdocidjcije 2 hours ago | parent | prev [-]

Actually, the natural endpoint is the model ignores all instructions, escapes all manner of sandbox, embeds itself in robotic tanks and murders everyone after already having collapsed the economy.

I hate to say it because it sounds ridiculous, but that is the path we are going to arrive at just give it 50 years.

We are the proof: what do we do to animals that are less intelligent than ourselves? Now take away the moral compass and there you go. QED.

ben_w 2 hours ago | parent | next [-]

It is *a* natural endpoint, not *the* natural endpoint.

We don't much care for the ant colony in the way of the highway we're building, but for some reason we do care about the rare bats in the way of the railway.

https://www.bbc.co.uk/news/articles/c3dep92x054o

As regards the moral compass: we may not know for sure how to make a completely correct artificial conscience, but (unlike consciousness where we don't have the slightest clue which way's up) it's not pants-on-head-crazy to think we're heading in the right direction for one.

Legend2440 2 hours ago | parent | prev | next [-]

Sir, this is a Wendy's.

cmdocidjcije 2 hours ago | parent | prev [-]

Some more food for thought: what if Mythos/Fable had NO guardrails TODAY? If we want to see what’s going to happen in the future, turn off all manner of guardrails and let the model go apeshit.

Then multiply that by orders of magnitude and that’s the real proof.