| ▲ | rarisma 7 hours ago | |
Their api stability genuinely makes no sense, how are they a near trillion dollar company with models so good they are treated as weapons yet have almost no 9's of uptime. If agi why not agi shaped? | ||
| ▲ | vanviegen 7 hours ago | parent [-] | |
Reliability issues occuring in the hypergrowth stage of a company's lifetime has always been pretty common, way before agents were involved in the scaling. And that was for products for which the computational load for a single client was negligible. For inference though, even a single client's load is pretty terrifying. | ||