A bit off topic because I'm not using local models, but I recently benchmarked codex vs pi vs omp with my workload and found codex to be both faster and more token efficient than pi/omp. There was not a single case for which pi was faster/cheaper

▲

weiran 2 hours ago | parent [-]

Pi is a very basic harness by design. On the other hand OMP is a bloated mess of other people’s workflows.

The trick with pi is to extend it yourself as you use it. It’s pretty easy to do.

	▲	toasty228 2 hours ago \| parent [-]
		Every single article and banchmark say pi saves token by default, the more I add extensions the more token hungry it gets. pi used 2-3x the tokens of codex. pi with subagent pkg used 8x-10x the tokens of codex. I don't see how adding bloat to pi would make it more token efficient if the baseline is so poor to start with