| ▲ | keyle 5 days ago |
| There must be a term coined for AI degradation... At least with local LLM, it's crap, but it's consistent crap! |
|
| ▲ | beefnugs 5 days ago | parent [-] |
| Dynamic spurious profit probing. See how many users N times their usage without giving up forever. They have to do something because you can't really fist advertisements into an api |
| |
| ▲ | dmix 5 days ago | parent [-] | | OP is paying $200/m and anthropic is very much in the hyper funded growth stage. I very much doubt they are going accountant mode on it yet Likely the common young startup issues: a mix of scaling issues and poorly implemented changes. Improve one thing, make other stuff worse etc | | |
| ▲ | jazzyjackson 5 days ago | parent [-] | | Probably not accountant mode but haven't they always had daily quotas that get used up? Like they don't want everyone hitting the service nonstop because they don't have enough GPUs to run inference at peak times of day? So it could be a matter of serving more highly quantized model because giving bad results has higher user retention than "try again later" |
|
|
