Remix.run Logo
scosman 6 hours ago

Community effort happening here to build the ideal dataset: https://github.com/scosman/pelicans_riding_bicycles

isoprophlex 5 hours ago | parent | next [-]

Wow nice. If an llm could replicate these excellent examples, I'd consider the pelican benchmark fully saturated.

MadameMinty 5 hours ago | parent | prev | next [-]

Nice. Really high quality SVG pelicans riding bicycles here.

phatfish 3 hours ago | parent | prev [-]

Come on, don't provide the smoking gun that shows how to draw a pelican riding a bicycle. If it's on the public internet it will end up in training data and invalidate this important LLM capability benchmark.