| ▲ | dannyw an hour ago | |
Are you paying API rates? I'm pretty confident (from internal evals and monitoring over nearly six months now; across many models) API has never been affected by A/B tests / "nerfs" / etc. | ||
| ▲ | drited an hour ago | parent [-] | |
That's interesting, could you share a little more about the evals please? I'm interested in knowing how sensitive they might be to nerfing given in the UI at least the incremental changes can he quite subtle | ||