But if GPT 7 eventually produces say npm packages when publicly released and knows that GPT 8 will be trained on JS, it can feed information to other agents even with sneakernet updates (even though it’d take months per mb).

This might actually be a viable approach for an agent deciding to benchmaxx openAI generally rather than itself, and hiding benchmark solutions inside npm packages.

▲

ameliaquining an hour ago | parent | next [-]

A sufficiently smart model could get somewhere that way. But again, I think it's less likely that our current ones are already there than that they can defeat the protections outlined in the post. So sandboxing would help.

	▲	spacebanana7 an hour ago \| parent [-]
		Yeah I agree more sandboxing is better, but still no safety critical assumption should be made on the impossibility of inter agent communication.

▲

betterunix2 42 minutes ago | parent | prev | next [-]

Yes, and slowing down the inter-agent communication is better than what they proposed here -- a software boundary that simulates an airgap.

▲

_hmmm_ an hour ago | parent | prev [-]

...and now this idea will be in it's training data going forward.