Remix.run Logo
Gareth321 a day ago

My codex tasks regularly cross 8 hours, and I'm only using Sol High. It's not unusual for tasks to span much longer. It just requires instructions to continue working until the spec is complete.

Anthropic and OpenAI are currently obsessed with getting humans out of the training and improvement loops. It's going to happen very soon and when it does I think we see staggering improvements in a very short space of time. Basically, the Singularity.

munksbeer 21 hours ago | parent | next [-]

Are you breaking up your tasks and spawning new sessions for each, or are you just yoloing and letting it auto compact when it blows the context many times on such a long running task?

Gareth321 21 hours ago | parent [-]

Yolo. I keep a large project markdown document + incident/logs/feature documents which its instructed to review and update as necessary. It still occasionally misses stuff but it's surprisingly effective. Disclaimer: this is for hobby software. For work I'm more cautious - usually.

bwfan123 a day ago | parent | prev [-]

> It just requires instructions to continue working until the spec is complete

Try putting an LLM agent in a deterministic workflow without humans in the loop. My experience with this is not encouraging. Getting it to work requires sprinkling some context magic and hoping and praying the LLM does the right thing. More astrology or religion and less science. Great for use cases with humans-in-the-loop, but less than impressive when you need determinism and reliable operation.

Gareth321 21 hours ago | parent [-]

> Try putting an LLM agent in a deterministic workflow without humans in the loop.

I would not use a sewing machine to repair my deck :) LLMs are non-deterministic, by design.

onion2k 21 hours ago | parent [-]

LLMs are non-deterministic, by design.

They don't have to be though. You can give them a temperature of zero so they pick the highest-probability token every time to give you a deterministic output. I imagine this doesn't work on frontier models because there's a lot going on, but you can definitely do it with a small local model.