> I always wonder how they make these long-running prompts and I guess they literally just tell it to "keep going".

Many harnesses support a /goal as well. When the agent thinks it's done, another LLM compares its results to the goal, and if not, tells it to keep going. It's quite easy to have agents working on something for hours this way.