Remix.run Logo
fcarraldo 3 hours ago

Does a mid-session provider switch result in loading the entire context into the new model, inflating session cost?

I don't think I understand the token/cost implications of this feature

gunalx 2 hours ago | parent [-]

Its nice if you used local, but needed å beefier modell, or more context Window. It will eat input tokens, but you do that all the time unless you have input caching.