| ▲ | Havoc an hour ago | |
What type of tasks did you use for this? Evaluation? Last time I did this I found it quite hard to come up with tasks that have clear evaluation outcomes | ||
| ▲ | bertmuir 34 minutes ago | parent [-] | |
Have it compare to the real work you've done in a sample of your previous sessions. Agents are good at simulating completing the work following newer harnesses, heuristics etc. and comparing time, tokens, quality, pitfalls. | ||