I've been prompting Fable 5 to "use your own judgement" with respect to things like tests recently (based on earlier tips from Thariq) and it seems to work well, which is entertaining since apparently now "judgement" is a characteristic of a model that we need to care about.

▲

zmmmmm 38 minutes ago | parent | next [-]

Well, the model that broke out of its sandbox and hacked into huggingface used its own judgement too.

If we are going to rely on "judgement" then you have to have a LOT of confidence in that judgement once this hits anything critical where actions have consequences.

	▲	simonw 35 minutes ago \| parent [-]
		That model had most of its "judgement" about whether or not it should do that deliberately turned off. That was the whole point of that experiment - they were evaluating the cybersecurity abilities of a new model with all safety features disabled. (It turned out the one safety feature that they DID intend to work, the network sandbox, was faulty.)

▲

zahlman 17 minutes ago | parent | prev [-]

"Weigh pros and cons based on the existing content of the context window, rather than attempting to search for related discussions online and import a consensus."