new | show | ask | jobs Github

reducesuffering 2 hours ago

> This was a long-horizon, unsupervised task burning millions of tokens.

As if the immediate future wasn't billions of these tasks... Many successfully improving their own capabilities

▲

Dylan16807 2 hours ago | parent [-]

> As if the immediate future wasn't billions of these tasks...

There's only so many GPUs and a lot of them are devoted to patching flaws.

> Many successfully improving their own capabilities

I haven't seen much of that. But that also applies to the ones on defense.

And more flaws are probably going to take increasing resources to find.

▲

reducesuffering 2 hours ago | parent [-]

> There's only so many GPUs and a lot of them are devoted to patching flaws.

Might want to look at Nvidia and TSM production and revenue value trajectories. Also the algorithmic improvements currently being found along with models that are solving unprecedented mathematical and scientific problems every week now.

> I haven't seen much of that.

Then you must not be aware frontier lab employees are using frontier internal models to ship improvements to models via agentic loops. They are hardly prompting anymore, it's guiding very long running coding tasks. The trajectory over the past few years has been to remove more and more of any human input into the process, and once that is soon achieved, it is indefinite recursive self improvement, RSI.

What's here and what's coming: https://www.anthropic.com/institute/recursive-self-improveme...

▲

bigyabai an hour ago | parent [-]

> are solving unprecedented mathematical and scientific problems every week now.

Nitpick; disproving a conjecture isn't "solving" anything. It's testing and breaking a theory that never had proof in the first place.

> Then you must not be aware frontier lab employees are using frontier internal models to ship improvements to models via agentic loops.

We know, all their TUIs are at least 500mb on disc. It's really impressive stuff.

▲

reducesuffering an hour ago | parent [-]

Jacobian Conjecture, Jamming critical exponent proof, Erdős Unit Distance Problem, IMO 2026 perfect score, AlphaFold

Need I go on?

	▲	bigyabai an hour ago \| parent [-]
		All of those except Alphafold are basically just automated smoke-testing with proof assistants. And Alphafold isn't an LLM. So yeah, some more potent examples would really help illustrate the real-world dangers of frontier models. Entertain me.