7 points trollied 56 minutes ago 1 comments

nylonstrung 12 minutes ago | parent

I don't really understand how async tool calls translate to token savings

It says that it removes tokens wasted while a model is waiting on synchronous tool calls. What tokens exactly is Pi using when waiting?