| ▲ | gozucito 32 minutes ago | |
I’d be happy with just some credits. Enough to offset any KV cache miss expenses is the absolute minimum. The smart play is to refund customers something like $20-50 worth of unsubsidized credits. Those are high margin and only the equivalent of 45 minutes of Fable usage once the KV cache reload costs are factored in. Yet customers often need a few credits to finish a job without waiting 5 hours or days for their reset. Keep in mind openAI already gives me free resets I can use when I want which are very useful to me. Seems a no brainer to tack those to subscriptions, actually. It gives the user a little more flexibility, a little more control over their tools. | ||