Remix.run Logo
BenzeneDream 2 hours ago

Why would it freeze if they can create more training material. Its already been shown synthetic training data is just as good if not better.

timcobb 2 hours ago | parent [-]

> Its already been shown synthetic training data is just as good if not better.

Source, please! I'm a machine learning layperson but how can this not be overfitting?

azakai 2 hours ago | parent | next [-]

For example, an LLM can prove a new theorem in math, verify it in Lean (so it is definitely true), and then prove more things based on that.

AI-generated data might not always be that useful, but at least in this case it obviously is.

esseph an hour ago | parent | prev | next [-]

https://arxiv.org/html/2609.26457v1

> AIDE demonstrates that recursive self-improvement at the harness layer can produce transferable gains in an AI research agent’s research efficiency. During the recursive self-improvement run, the loop accepted seven rewrites, each under a fixed evaluation budget (section 3.2). Under this fixed evaluation budget, gains in optimization capability on AI R&D tasks translate to gains in research efficiency."

https://arxiv.org/abs/2609.11873

> The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement

aaron695 39 minutes ago | parent | prev [-]

[dead]