The best part is using harnesses like reasonix or whale make cache hit at a rate close to 98%, making requests converge to practically free. And that's with unsubsidized American providers like cloudflare or Digital Ocean.

▲

KronisLV an hour ago | parent | next [-]

In long form tasks, across multiple harnesses (Claude Code, OpenCode, Kimi Code, ZCode) my cache rates are typically 96-99%.

I don’t think that’s particularly out of the ordinary. Do people have different experiences with other harnesses? Which ones?

▲

mlazos an hour ago | parent | prev | next [-]

How can you be hitting cache on what I think are novel LLM prompts …

	▲	oceansweep an hour ago \| parent \| next [-]
		Not them but my understanding is that the harness will send a simple 'heartbeat' message to keep the cache 'warm', (see prefix caching: https://handbook.modular.com/inference-optimization/prefix-c... ) which can then be edited/changed, which does cause the user to incur a fee, but its much less than the amount they'd pay on a no-cache hit request.
	▲	verdverm an hour ago \| parent \| prev [-]
		multi turn sessions, they are typically in the high 90% hit rate across all providers without doing much of anything

▲

sghiassy an hour ago | parent | prev [-]

I’ve never used either of those tools. Do they work well?