| ▲ | jgalt212 4 hours ago | |||||||
A medium prompt = 1 million tokens? | ||||||||
| ▲ | RugnirViking 3 hours ago | parent [-] | |||||||
How many times have you had a model start compacting already before getting back to you? Most have 1 million context window. It's happened to me occasionally | ||||||||
| ||||||||