| ▲ | ttoinou an hour ago | |
I’m already able to use 1M context windows with the same machine than you and same model. Strange | ||
| ▲ | vlowther 6 minutes ago | parent [-] | |
Yeah, most of what I did was to add fused TQ support to leave more memory free for other nefarious purposes. | ||