| ▲ | dpkirchner 18 hours ago | |
Progressive disclosure is good for reducing context usage but it also reduces the benefit of token caching. It might be a toss-up, given this research result. | ||
| ▲ | deaux 5 hours ago | parent [-] | |
Those are different axes - quality vs money. Progressive disclosure is invaluable because it reduces context rot. Every single token in context influences future ones and degrades quality. I'm also not sure how it reduces the benefit of token caching. They're still going to be cached, just later on. | ||