Remix.run Logo
isaacremuant 4 days ago

I can't reproduce it. Or similar ones. Why do yout think that is?

ceejayoz 4 days ago | parent | next [-]

Because it’s embarrassing and they manually patch it out every time like a game of Whack-a-Mole?

isaacremuant 4 days ago | parent [-]

Except people use the same examples like blueberry and strawberry, which were used months ago, as if they're current.

These models can also call Counter from python's collections library or whatever other algorithm. Or are we claiming it should be a pure LLM as if that's what we use in the real world.

I don't get it, and I'm not one to hype up LLMs since they're absolutely faulty, but the fixation over this example screams of lack of use.

alexjplant 4 days ago | parent | prev [-]

"Mississippi" passed but "Perrier" failed for me:

> There are 2 letter "r" characters in "Perrier".

isaacremuant 4 days ago | parent [-]

Thanks! I finally was able to reproduce one of these.

Ok. Then I was wrong. I'll update my edit accordingly.