| ▲ | yieldcrv 3 hours ago | |
> It gets into loops quite often matches my experience and a deal breaker also the context window sizes are too low. I can't operate in 65,000 windows any more because even just reading the code's file structure overruns it and gets me nowhere. Definitely its own art form. 200k context windows and above for me now I saw a paper last night that should help this a lot though | ||
| ▲ | kennywinker 2 hours ago | parent | next [-] | |
Qwen3.6-35b handles 256k context fine if you’ve got room for it. I’m running it with 128k context with just 16gb vram. | ||
| ▲ | Greenpants 2 hours ago | parent | prev [-] | |
I get that it's a deal breaker to some; it definitely requires patience. In Pi, /new is my best friend and most-used command for sure. For simple tasks (I decompose complex ones anyway since I don't trust small local LLMs to do this for me), the model doesn't need much context, given that I'm proficient in my codebase myself: "I'd like Feature X. Look into files 1, 2 and 3 to make your edits." | ||