That's a super neat approach.

But the core issue seems to be: How do you come up with the fitness function that drives the evolutionary process without human intervention in the first place?

(I've tried something similar with a coding agent where I let the agent modify parts of its system prompt... But it got stuck very fast since there was no clear fitness function)