Remix.run Logo
▲ purpleidea an hour ago

I'd pay twice as much per token if there was a guarantee they weren't nerfing the model and if it is as good as the original Fable was when it was released. I'm doubtful though. Whatever "tweaks" they've been doing (safety? performance? "saving the best for ourselves") has really taken away the magic for me. I want the LLM magic back.

▲dannyw an hour ago | parent [-]

Are you paying API rates?

I'm pretty confident (from internal evals and monitoring over nearly six months now; across many models) API has never been affected by A/B tests / "nerfs" / etc.

▲drited an hour ago | parent [-]

That's interesting, could you share a little more about the evals please? I'm interested in knowing how sensitive they might be to nerfing given in the UI at least the incremental changes can he quite subtle