Remix.run Logo
staticman2 3 days ago

The Guardrails on Claude Sonnet 3.5 API are not stricter than Openai's guardrails in my experience. More specifically, if you access the models via API or third party services like Poe or Perplexity the guardrails are not stricter than GPT4o. I've never subscribed to Claude.ai so can't comment on that.

I have no experience with Claud.ai vs ChatGPT but it's clear the underlying model has no issue with guardrails and this is simply an easily tweaked developer setting if you are correct that they are stricter on Claude.ai.

(The old Claude 2.1 was hilariously unwilling to follow reasonable user instructions due to "ethics" but they've come a long way since then.)

dragonwriter 3 days ago | parent | next [-]

> The Guardrails on Claude Sonnet 3.5 API are not stricter than Openai’s guardrails in my experience.

Both Gemini and Claude (via the API) have substantially tighter guardrails around recitation (producing output matching data from their training set) than OpenAI, which I ran into when testing an image text-extraction-and-document-formatting toolchain against all three.

Both Claude and Gemini gave refusals on text extraction from image documents (not available publicly anywhere I can find as text) from a CIA FOIA release

Not sure if they are tighter in other areas.

staticman2 3 days ago | parent | next [-]

I just asked GPT4o to recognize a cartoon character (I accessed it via Perplexity) and it told me it isn't able to do that, while Claude Sonnet happily identified the character, so this might vary by use case or even by prompt.

rwalle 3 days ago | parent | prev | next [-]

Have you had luck with Google's AI Studio with regard to text extraction?

msp26 3 days ago | parent | prev [-]

I've had a situation where Claude (Sonnet 3.5) refused to translate song lyrics because of safety/copyright bullshit. It worked in a new chat where I mentioned that it was a pre 1900s poem.

staticman2 3 days ago | parent [-]

I've translated hundreds of pages of novel text via Sonnet 3.5. But I did it where I have system prompt access and tell it to act as a translator.

ipaddr 3 days ago | parent | prev [-]

My comment was purely about Claud.ai which is where general customers would go.

staticman2 3 days ago | parent [-]

I don't know if Claude.ai or ChatGPT are even profitable at this stage, so they might not particularly want general customers.