> Its already been shown synthetic training data is just as good if not better.

Source, please! I'm a machine learning layperson but how can this not be overfitting?

For example, an LLM can prove a new theorem in math, verify it in Lean (so it is definitely true), and then prove more things based on that.

AI-generated data might not always be that useful, but at least in this case it obviously is.

https://arxiv.org/html/2609.26457v1

> AIDE demonstrates that recursive self-improvement at the harness layer can produce transferable gains in an AI research agent’s research efficiency. During the recursive self-improvement run, the loop accepted seven rewrites, each under a fixed evaluation budget (section 3.2). Under this fixed evaluation budget, gains in optimization capability on AI R&D tasks translate to gains in research efficiency."

https://arxiv.org/abs/2609.11873

> The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement

[dead]