Remix.run Logo
granitepail an hour ago

A great deal of their research has been focused on zigging where others zag. Their paper "Continuous Thought Machines" (https://arxiv.org/abs/2505.05522, presented at NeurIPS) was posed specifically under the framing of there needing to be more fundamental research beyond squeezing as much as we can out of relatively vanilla transformer stacks. It is very biologically inspired and unique.

Now that models are getting stronger at agentic work, it is very natural that many labs are chasing some form of auto-research.

laughingcurve an hour ago | parent [-]

It's natural for literally any AI lab to end up doing auto-research, since 'auto-research' is literally just 'autonomous AI' which is the whole darn point of all of this. I'm not going to hand out genius brownie points to folks working on RSI because of course its powerful. How about we hand brownie points to the folks who do things that are not hype and end up being important/powerful?

> was posed specifically under the framing of there needing to be more fundamental research beyond squeezing as much as we can out of relatively vanilla transformer stacks.

Not to be contentious, but this is so broad of a description that it could include literally thousands of papers in the last year or two. I'm imagining double digits or more if we go back the full decade.

I'm saving brownie points for people who deserve them