| ▲ | NortySpock 2 hours ago | |
If the local model is served via ollama, there's a default timeout of 10 minutes , which can be adjusted either per-call , or (as I did) in the systemd service environment variables https://docs.ollama.com/faq#how-do-i-keep-a-model-loaded-in-... You didn't specify what was serving your local model. | ||
| ▲ | rvba 2 hours ago | parent [-] | |
Thank you for your reply. I use LM studio (local server), but can switch to a different tool. Do you know how to switch it in LM studio? What I see is that: android studio gives "Error: stream failed" and in LM studio server I see it is still working, then says that client (=android studio) disconnected. So I assumed it was a setting in android studio. | ||