First test question: "Is the UV Index a good proxy for when to wear sunglasses." Immediately triggered the safety filter ... oh dear.

msp26 an hour ago | parent | next [-]

It triggered for me when I asked "Web search for your own model card (released today) and pick out your favourite highlights from the pdf"

aix1 2 hours ago | parent | prev | next [-]

Did not trigger for me (Fable answered the question), so I guess the filters are either non-deterministic or are still being tweaked.

Interesting, I assumed all model-routing was done utilizing an LLM. (I.e. non-deterministic.)

	▲	tuvix an hour ago \| parent \| next [-]
		It’s possible that there’s a set of words or phrases that route deterministically to save money on obvious stuff. I kind of wonder, though, which model they’re using to do the routing. It seems like a huge added cost to do these kinds of checks on every request
	▲	eugmai86 30 minutes ago \| parent \| prev [-]
		[dead]

Narretz 2 hours ago | parent | prev [-]

Iirc correctly Opus 4.7 had the same problem, safety filters were triggered way too easily at the beginning.