| ▲ | rybosworld 3 hours ago | |||||||||||||
Suppose a company has a limited amount of compute. What do they then do if peak demand exceeds what they can provide? They don't turn off people's access... And what about A/B testing? Anthropic doesn't even try to hide that they do this. Limited compute and A/B testing alone, would guarantee a nerfed experience some of the time. That is, you don't even need a nefarious reason. I consider it gas lighting to deny model nerfing. | ||||||||||||||
| ▲ | brainwad 2 hours ago | parent | next [-] | |||||||||||||
> They don't turn off people's access... They do drop requests though? At peak times I sometimes have 1-2 requests fail with Opus; no biggie, the harness just retries it. But that, in aggregate, sheds load. | ||||||||||||||
| ||||||||||||||
| ▲ | fwip 2 hours ago | parent | prev | next [-] | |||||||||||||
You serve the requests more slowly. Same as if your bank has a sudden rush of customers - the tellers serve them in order, and the customers wait longer. Some of the customers 'time out' (get frustrated and leave). | ||||||||||||||
| ||||||||||||||
| ▲ | margalabargala 3 hours ago | parent | prev [-] | |||||||||||||
I'm not denying model nerfing. I'm asserting an opinion about the nature of the nerfing. If you want to go accuse someone of denying model nerfing, go find someone doing it and argue with them. | ||||||||||||||