Remix.run Logo
Gareth321 21 hours ago

> Try putting an LLM agent in a deterministic workflow without humans in the loop.

I would not use a sewing machine to repair my deck :) LLMs are non-deterministic, by design.

onion2k 21 hours ago | parent [-]

LLMs are non-deterministic, by design.

They don't have to be though. You can give them a temperature of zero so they pick the highest-probability token every time to give you a deterministic output. I imagine this doesn't work on frontier models because there's a lot going on, but you can definitely do it with a small local model.