| ▲ | giancarlostoro 5 days ago |
| GPT OSS 20B is smart enough but the context window is tiny with enough files. Wonder if you can make a dumber model with a massive context window thats a middleman to GPT. |
|
| ▲ | pdntspa 5 days ago | parent [-] |
| Matches my experience. |
| |
| ▲ | giancarlostoro 5 days ago | parent [-] | | Just have it open a new context window, the other thing I wanted to try is to make a LoRa but im not sure how that works properly, it suggested a whole other model but it wasnt a pleasant experience since it’s not as obvious as diffusion models for images. |
|