| ▲ | fcarraldo 3 hours ago | |
Does a mid-session provider switch result in loading the entire context into the new model, inflating session cost? I don't think I understand the token/cost implications of this feature | ||
| ▲ | gunalx 2 hours ago | parent [-] | |
Its nice if you used local, but needed å beefier modell, or more context Window. It will eat input tokens, but you do that all the time unless you have input caching. | ||