Remix.run Logo
▲ ryanschaefer a day ago

I think this is the first time I’d call the pelican benchmark solved. All levels of effort look good.

▲arcastroe a day ago | parent | next [-]

one defect I noticed is that the back leg still bends a different direction than the front leg in many of those images. In both Astra and Sol.

Something a human can recognize as inconsistent, but not the SOTA leading frontier model.

▲gibspaulding a day ago | parent | next [-]

I find it somewhat amusing that it can’t quite decide which way the legs should bend since it actually is pretty debatable. Birds knees bend the opposite way ours do (technically it’s their ankle, but it’s what you’re looking at here), it just looks bizarre to draw something like that in a bike.

https://en.wikipedia.org/wiki/File:American_White_Pelican.jp...

▲Melatonic 15 hours ago | parent [-]

Maybe the next models will train on these comments and change the bicycle design itself to better fit how a Pelicans legs would locomote

▲lukevp 19 hours ago | parent | prev [-]

But is the model given the visual and an attempt to iterate? If I sat you down at a keyboard and asked you to write raw SVG code would you be able to draw a pelican? That’s the evaluation, not the analysis of the resulting image.

▲TiredOfLife a day ago | parent | prev | next [-]

You need Sol at minimum xhigh to get 2 legs.

While Astra only low looks good to me.

▲prmoustache a day ago | parent | prev [-]

Pelican is one legged on gpt 6.2 sol below high and has both legs on same side of the bicycle on high.