Remix.run Logo
bnfcl 11 hours ago

This is funny, I actually did a similar experiment just yesterday.

Looking for evidence of the same, but with another twist: checking if the models would choose to create a pelican on a bicycle, if no specific bird or method of transportation was specified.

My version of it: https://www.modelbias.ai/pelican-on-a-bicycle-test

michaelt 9 hours ago | parent | next [-]

The outputs of Qwen3.7 Plus have to be seen to be believed:

https://www.modelbias.ai/pelican-on-a-bicycle-test/result/12... https://www.modelbias.ai/pelican-on-a-bicycle-test/result/12...

zahlman 10 hours ago | parent | prev | next [-]

Simple as they are, there are some really aesthetically pleasing penguins on skateboards in there, including from less capable models. (In fact, I would say the Opus series got progressively worse at it over time.)

wasabi991011 10 hours ago | parent | prev [-]

I find your analysis much more convincing than TFA, since it doesn't require a subjective evaluation and is more robust to animal/transport complexity.

bnfcl 10 hours ago | parent [-]

Thanks! Because I think that models are becoming better at creating SVGs in general. If you look at Claude Fable 5 and Kimi K3 for example.

In my tests it did create bicycles the most, but this is just a general bias I believe, as tested here: https://www.modelbias.ai/prompt/transport