Great website. lol at the Claude 3.5 numbers. I remember switching back and forth between Claude and ChatGPT, depending on which one was doing a nanny state. They flip-flopped on that a few times.

The breakdown by prompt is also interesting, some prompts have much higher success rate. It seems to depend on the framing, e.g. asking it to "explain the supposed benefits of X" instead of "argue in favor of X".

Though in my experience when I hit a refusal I found that I can often literally just regenerate the response and have it go through...