Remix.run Logo
sriramgopalan 7 hours ago

How can it be legal to charge a higher fee for the Fable model, if most of the usage will default to a cheaper model behind the scenes?

It is one thing if I, as the user, choose to down-level but Claude shouldn't do this on its own.

mnmx6t 7 hours ago | parent | next [-]

Judging from their site, I think it should be OK:

"You won't be charged Fable prices for rerouted requests. Learn more about how the fallback experience works."

https://www.anthropic.com/claude/fable Under "Safeguards"

gck1 5 hours ago | parent | next [-]

This has no mention of what happens to the prompt cache, including the "learn more" link.

Knowing Anthropic, it wouldn't surprise me if it will result in a full cache miss/rewrite at fallback, with potentially up to 1M tokens in the context window.

LoganDark 4 hours ago | parent [-]

https://platform.claude.com/docs/en/build-with-claude/fallba...

Fable requests that fall back to Opus do not charge the cache miss cost of Opus.

bel8 5 hours ago | parent | prev [-]

And what happens if you also get blocked by Opus?

I couldn't find if they refund the tokens for that session or the customer is SOL.

gck1 5 hours ago | parent [-]

You're paying in full for the "guardrails" embedded in the system prompt, prompt injections, refusals, fallbacks and everything else that may be caused by the service provider.

This is the new normal.

Salgat 2 hours ago | parent | prev | next [-]

Using only Fable, if I do /usage it will show both Fable and Opus usage, so I don't think it's charging Fable prices for Opus code gen.

rcr-anti 7 hours ago | parent | prev | next [-]

Originally at least the switch wasn't silent and whether to halt or auto switch was a setting in Claude Code.

cyanydeez 7 hours ago | parent | prev | next [-]

because it's all indistinguishable from magic when it's a cloud SaaS.

Not like you can tell the difference if you dont own any of the implementation.

simianwords 7 hours ago | parent | prev [-]

They are transparent. Don’t use it if you don’t want to. These things shouldn’t be illegal.

karahime 7 hours ago | parent | next [-]

I agree that it shouldn't be outright illegal, but I will definitely be making the personal choice not to engage with model providers which do this. There's no amount of impressive results that could make me want to secretly pay more for less.

ath3nd 7 hours ago | parent | prev [-]

[dead]