| ▲ | p_stuart82 2 hours ago | |
Does this catch intermittent fallback between requests? | ||
| ▲ | logickkk1 2 hours ago | parent [-] | |
Yes, picchio monitors a running llama-server on a timer and flags when the prefill/decode ratio goes CPU-shaped. I hot-swapped one mid-run. probe 4 caught ENGAGED -> NOT ENGAGED. | ||