Remix.run Logo
humamf 5 hours ago

The pisa tower test is really interesting. Many of this prompt have stricter criteria with implicit knowledge and some models impressively pass it. Yet for something as obvious as straightening a slanted object is hard even for latest models.

kridsdale3 4 hours ago | parent [-]

I suspect there'd be no problem rotating a different object. But this tower is EXTREMELY represented in the training data. It's almost an immutable law of physics that Towers in Pisa are Leaning.

gridspy 4 hours ago | parent [-]

It's also a tower that has famously been deliberately un-straightend just enough to remain a tourist attraction while remaining stable.