| ▲ | Gareth321 21 hours ago | |
> Try putting an LLM agent in a deterministic workflow without humans in the loop. I would not use a sewing machine to repair my deck :) LLMs are non-deterministic, by design. | ||
| ▲ | onion2k 21 hours ago | parent [-] | |
LLMs are non-deterministic, by design. They don't have to be though. You can give them a temperature of zero so they pick the highest-probability token every time to give you a deterministic output. I imagine this doesn't work on frontier models because there's a lot going on, but you can definitely do it with a small local model. | ||