Remix.run Logo
nylonstrung 4 hours ago

I don't really understand how async tool calls translate to token savings

It says that it removes tokens wasted while a model is waiting on synchronous tool calls. What tokens exactly is Pi using when waiting?

332451b an hour ago | parent | next [-]

"More tool work per model turn" could reduce the number of cache reads (or even cache misses) and associated cost?

dumberquestions 3 hours ago | parent | prev [-]

I think a running agent periodically checks if a process it started has finished.

3 hours ago | parent [-]
[deleted]