reading that tweet it came across to me that he set the agent up for failure. garbage in, garbage out! maybe a more fair comparison would have been a prompt to design & implement the renderer with a clean start. throwing it all out and starting from scratch is something these models, and people, are explicitly trained against doing

other than that, I don't think any serious person would trust a ralph-loop to accomplish something truly substantial. it's good for ensuring rote tasks get completed without the agent stopping too soon, but not much more

I guess it depends on what your definition of truly substantial is.

With the right objective function and enough compute I think you can definitely make progress. A lot of problems can be framed as search.

I think some of these proofs coming out is a good example of this.