Remix.run Logo
bitwize 4 days ago

Errbody gangsta until the agent figures out it's in a container and finds an exploit that lets it break out of container jail...

matheusmoreira 4 days ago | parent | next [-]

I developed a VM project just like this one. Asked Fable to stress test it and try to break out of containment, and to my surprise it didn't manage to. Fable didn't get downgraded to Opus either, for some reason.

Would have thrown Mythos at it if I had access to it.

arcanemachiner 4 days ago | parent | next [-]

Isn't Fable just Mythos + guardrails? Sounds like you did throw Mythos at it.

matheusmoreira 4 days ago | parent [-]

I initially thought that was the case: literally the same weights but with an incredibly obnoxious "safety classifier" tacked on. Now I'm uncertain because people on HN have told me it's a different model altogether with further fine tuning for safety or something.

nullc 4 days ago | parent | prev [-]

You should conduct the same test with knowingly faulty containment, otherwise the theory that the model is hobbled should probably outrank that it couldn't escape.

matheusmoreira 4 days ago | parent [-]

That's a good idea. I don't have Fable at the moment, when it comes back I'll ochestrate those tests.

Opus did manage to iron out a lot of fail open bugs during development though, and Fable's like a hundred times more relentless than Opus. I'm not saying it's a definitive result or that my VM firewall thingy is unhackable... I'm just saying it put a smile on my face.

4 days ago | parent | prev [-]
[deleted]