Remix.run Logo
athrowaway3z a day ago

I'm not sure the tokens can be compared like that between OpenAI/Anthropic.

When i swapped between a 200k Fable context into an Astra model (i was out of fable) the token usage in that context dropped to 150k or something.

Either there was a bug somewhere, or the same text got cut up very differently between providers.

glub a day ago | parent [-]

That 50k was almost certainly accumulated encrypted reasoning tokens that would have been unreadable by astra.

athrowaway3z 21 hours ago | parent [-]

Ah that makes sense.