| ▲ | sva_ 3 hours ago | |
In 95% of cases it is because you had a large context for which the cache expired. | ||
| ▲ | bearjaws 2 hours ago | parent [-] | |
The amount of people I see running around at 800k context and wondering why they are burning through tokens is always surprising. | ||