Remix.run Logo
fc417fc802 an hour ago

What's the expected state space of effective regulation though? Note that we've got passable coding models down to ~30B parameters by now. And keep in mind the ultimate floor here - the human brain only consumes on the order of 20 watts and fits in a handbag.

Is there any possible solution other than mass proliferation where the models are used to keep one another in check? Either that or a religious prohibition against the existence of integrated electronics.

metalcrow an hour ago | parent [-]

The regulations don't have to address the end goal, but the process of development itself. Even just a pause on frontier research is a good start

fc417fc802 28 minutes ago | parent [-]

What I'm asking is, why should we expect that to effectively further the end goal? You're simply asserting that it will ultimately do so.

Given the efficiency gains we've seen it seems to me that the situation has shifted from being analogous to producing nuclear weapons to producing something much closer to small arms.

metalcrow a minute ago | parent [-]

To further the metaphor, didn't the ban on nuclear weapons research work? We don't have pocket nukes, and there's very little risk of random countries acquiring their own due to the amount of work involved. To be concrete to AI: if we stop work on the frontier, the best we can do is make the current frontier easier to get to and more accessible. And while current frontier is strong, it's not world-changing so. The only way for the frontier to get to that level is to do research on it, and stopping that research gives time to help develop plans to not make it world-changing when we get to it.