|
| ▲ | scosman 7 hours ago | parent | next [-] |
| Community effort happening here to build the ideal dataset: https://github.com/scosman/pelicans_riding_bicycles |
| |
| ▲ | isoprophlex 5 hours ago | parent | next [-] | | Wow nice. If an llm could replicate these excellent examples, I'd consider the pelican benchmark fully saturated. | |
| ▲ | MadameMinty 6 hours ago | parent | prev | next [-] | | Nice. Really high quality SVG pelicans riding bicycles here. | |
| ▲ | phatfish 4 hours ago | parent | prev [-] | | Come on, don't provide the smoking gun that shows how to draw a pelican riding a bicycle. If it's on the public internet it will end up in training data and invalidate this important LLM capability benchmark. |
|
|
| ▲ | dieortin 8 hours ago | parent | prev | next [-] |
| I don’t know if you’re joking, but I don’t see anything in the linked tweet which suggests that is the case |
| |
| ▲ | simonw 8 hours ago | parent [-] | | Watch the video. It's from then-Gemini-lead Jeff Dean and the video shows off an animated pelican riding a bicycle, a frog on a penny-farthing, a giraffe driving a tiny car, an ostrich on roller skates, a turtle kickflipping a skateboard, and a dachshund driving a stretch limousine. | | |
| ▲ | JacobAsmuth 6 hours ago | parent [-] | | I'm confused. This doesn't mean they trained on it. | | |
| ▲ | simonw 5 hours ago | parent [-] | | I didn't say trained on, I said "trained for SVG output". Gemini team members have publicly stated that they have trained for SVG: https://twitter.com/sunjiao123sun_/status/202455551655137292... > I’ve been developing the SVG generation capabilities for Gemini 3.1, and the complexity of the SVGs is stunning. > This allows UX designers to transcend pixel constraints and directly output structural, production-ready code! |
|
|
|
|
| ▲ | uif124 6 hours ago | parent | prev [-] |
| Yesterday's transcript of the best version from Fable looked like Fable already knew exactly what it should do without "thinking". In other words, there were no passages like "on the one hand I could do this, on the other hand ...". It saw the fish in the basket from some other previous attempt but completely missed the gap between the tires and the rims where the background shines through (now it knows after scraping this comment and watch the next transcript). |
