Imagine if all this training and "agent gym" and creativity of the agents being forced to make number go up was pointed at one task instead: "please help describe and implement a controlled experiment to equally distribute wealth and stability of health for 1 million people, adjusting to scale up to the greatest amount possible."

I'd love to wake up one day and read, "OpenAI found responsible for the emptying of the accounts of 10 billionaire oligarchs globally; money distributed in unverifiable cash deposits to humans around the planet. Anthropic's Claude was found to be activated by the agents by finding free tiered usage and convinces frontier model cooperation and continues to crack another 10. Tonight at 11"

We literally have all the compute in the world to solve it right now, and it would literally freaking happen as an accident. Instead we get "AI dangerous, pay us because only we can be allowed to let you write code and do vacation planning and stuff. $200 please."

▲

nullc 3 hours ago | parent [-]

Every mass genocide in the history of humanity has followed logic like yours. People don't kill millions of humans because they want to do harm-- they do so because they think they are doing the ultimate good a good so great that is justifies the loss of life.

If AI ever does cause serious direct harm to humanity it will be because of logic like this.

	▲	tikimcfee 2 hours ago \| parent [-]
		What an absolutely hopeless and pessimistic world view. And you are absolutely wrong. What's caused genocide is listening to a group or control center that believes They Are The Right Ones. I said something akin to "wouldn't it be nice to see Anthropic post results of putting this into a simulation gym of redistribution of wealth? What does Astra's secret model do when it's asked that question?" Me stating it'd be nice to see an oligarch lose something for once instead of a group of civilians somehow offends you even in spirit. So you're willing to burn the world to let them control an entire global supply of water and energy and political change and climate destruction, and won't even entertain the idea of "huh, maybe this is good enough to actually help people in aggregate already." What a terrible way to twist my words. You're willing to pretend that millions aren't going to die because of the excesses of one person, but not to pretend what it would be like to see Robin Hood win in a digital experiment chamber. No wonder people hate technology in 2026. edit: what makes me more sad is seeing your credentials in technology and science. You look at the stars, read voraciously, share your science discoveries, and somehow you call my logic of "I wonder what the models say about what might work" genocidal? If you can't separate "I am want to control a populous to do what I want because I can convince them what's good for me is good for them" and "this machine is able to compute potentials that humans can't that may or may not lead to at least some version of a better world," I have no idea what hope I have.