| ▲ | shermantanktop 2 hours ago | |
Agree. Switching models with a keypress is for developer coding. Jev and this decisions api are mostly useful for inference at scale in a workload where cost and latency matter… and that’s where evals become crucial. Could coding tools use it? Sure, but that’s probably a special case. | ||