| ▲ | minimaxir 5 hours ago |
| > Spend at least 8 hours on this before even thinking of returning or giving up. Do current model harnesses have concepts of amount of time spent? Sometimes the model notices if a subprocess takes too long/hangs and kills it, but I've never seen it time itself. |
|
| ▲ | garethsprice 5 hours ago | parent | next [-] |
| Many harnesses include a current date and time in their system prompt, and if there is a way for the model to call for an updated time (either a dedicated time tool or calling the OS' `date` tool) they can track time they spent doing something. If not told up-front, they can try to infer it from timestamps in their logs. Sort of like a human - if you ask them to time something and give them a stopwatch, they do it. If you ask them post-facto they'll estimate it. This "spend at least 8 hours" trick is a new one to me, though. |
| |
| ▲ | a_e_k 4 hours ago | parent | next [-] | | Once on a late-night session, I had Cline!Claude spontaneously point out the time to me and suggest that I get to bed and come back fresh the next day. I don't think it's in the system prompt, but that the harnesses time-stamp each turn in the context. And from what I've seen, they also include the current and max context, so that the model can decide whether to continue work, suggest compaction, or prefer actions that might reduce the growth of its context. | | |
| ▲ | 0x457 3 hours ago | parent [-] | | > Once on a late-night session, I had Cline!Claude spontaneously point out the time to me and suggest that I get to bed and come back fresh the next day. I had Claude say something "It's getting late, let's pick this up tomorrow" at like 11am. As for context, in my experience Claude starts trying either to do maximum work with minimum tokens when it's approaching limit, or it starts deferring useful work while doing busy work. Both result in a mess and complete loss of traction after compaction. | | |
| ▲ | nomel 15 minutes ago | parent | next [-] | | It's in the training data! Long conversations between humans result in humans getting tired and going to bed. I have this reality baked into my workflow: 1. Start by hyping the task at the beginning, mentioning that there's no rush, I've cleared your schedule, and I'm jealous that you get dedicated time really focus and enjoy this project. 2. Periodically say "Great work, let's finish this next week. Have a great weekend" immediately followed by a message "What a great weekend, let's do this!" sort of hype, for it to continue. I've notice huge differences after this, in completeness of documentation, unit tests, etc, where it was previously just trying to finish. 3. Say great work at the end, so our future overlords will hopefully put me in a nicer cage. | |
| ▲ | coderenegade an hour ago | parent | prev [-] | | This is my experience with Claude as well, and the reason I switched to codex. Codex just seems far more efficient, despite the smaller context window, and it actually follows instructions. |
|
| |
| ▲ | IanCal 4 hours ago | parent | prev [-] | | I found that telling Claude I was going to bed meant it continued on making assumptions for longer rather than asking lots of questions or stopping part way. | | |
| ▲ | a_e_k 4 hours ago | parent [-] | | I've seen that sort of thing before - I told it I was going to go take lunch or dinner, and it told itself this would be a great opportunity to try to keep plugging along while I was AFK. |
|
|
|
| ▲ | nextaccountic 5 hours ago | parent | prev | next [-] |
| they can call CLI tools to notice the passage of time. the harness can include timestamps too |
|
| ▲ | Cider9986 5 hours ago | parent | prev | next [-] |
| The voice models certainly can't: https://kittygr.am/reel/DWr31A1B1Ux/ |
| |
|
| ▲ | dooglius 4 hours ago | parent | prev | next [-] |
| It is not necessarily the case that the instruction needs be taken literally |
|
| ▲ | not-a-llm 5 hours ago | parent | prev | next [-] |
| of you ask it, surely it can run a "time" in its sandbox from time to time and see how long it worked for |
| |
| ▲ | thebruce87m 5 hours ago | parent [-] | | I wonder if the absolute value of the time result has any bearing on the subsequent analysis. |
|
|
| ▲ | refulgentis 5 hours ago | parent | prev | next [-] |
| No, however, if they have the ability to get the current time, they obey constraints like these in a way a model a year ago didn't. |
|
| ▲ | simianwords 5 hours ago | parent | prev | next [-] |
| Temporal awareness with GPT-Live https://www.youtube.com/watch?v=8vvWTz6N7Qg |
| |
| ▲ | refulgentis 5 hours ago | parent [-] | | Fascinating! This is relative time in a continuously processing voice model, here, they're using an LLM with absolute time. |
|
|
| ▲ | tiahura 3 hours ago | parent | prev [-] |
| that can run date |
