| ▲ | fwip 2 hours ago | |
You serve the requests more slowly. Same as if your bank has a sudden rush of customers - the tellers serve them in order, and the customers wait longer. Some of the customers 'time out' (get frustrated and leave). | ||
| ▲ | rybosworld 2 hours ago | parent | next [-] | |
> You serve the requests more slowly. Thats not what Openai and Anthropic do though | ||
| ▲ | vhantz 2 hours ago | parent | prev [-] | |
I guess there's an alternate universe where that happens | ||