Remix.run Logo
tomrod 5 hours ago

Its a nice benchmark. Like hearing the ice cream truck on a summer day.

hypfer 5 hours ago | parent | next [-]

It's both.

I agree to rednb that at this point it feels like rather obvious brand building, but also, I agree with you that some value is in it.

It does not feel all that authentic though, and it's good to react allergically to lack of authenticity. Bad for a lot of business models, but good for humanity.

squidbeak 3 hours ago | parent [-]

Sorry mate, but you sound jealous in all these replies that the Pelican domain isn't your gig. The below is as labored as nitpicks ever get:

> It does not feel all that authentic though, and it's good to react allergically to lack of authenticity. Bad for a lot of business models, but good for humanity.

I hope SimonW keeps them coming.

hypfer 3 hours ago | parent [-]

My ancestors are smiling at me, Imperials. Can you say the same?

tomashubelbauer 4 hours ago | parent | prev | next [-]

More like living next to an ice cream truck car park

neutronicus 4 hours ago | parent | prev | next [-]

Every parent groans haha

risyachka 5 hours ago | parent | prev [-]

At this point it does not show anything as models are fine tuned on all kinds of benchmarks.

SoMomentary 3 hours ago | parent [-]

I thought the Gemini 3.5 Flash Lite response was quite telling myself. I personally like the Pelican SVG test, to me it is still a charming snapshot of model performance anecdata. No one would argue it's rigorous but I don't think it was ever intended to be.

I get people burning out on the pelican SVG test alongside the rest of the AI burnout, but I guess for myself I'm just choosing to keep enjoying it while I still can.