| ▲ | gls2ro 4 hours ago | ||||||||||||||||
Engineering practices or best practices are much more than writing code. So not sure what we are debating here: I see first hand companies jumping full on using LLM for _everything_ for the last 6 months (of course Anthropic longer) and without guardrails and good engineering practices the number of incidents, downtime is increasing. Look at status.claude.com - Anthropic could at any point come out and say all those are due to third party providers. I am also not saying here Anthropic is worse than other scaleups. But they do something different: they come in front of us and tell us they have better engineering practices. | |||||||||||||||||
| ▲ | hombre_fatal 4 hours ago | parent [-] | ||||||||||||||||
> Anthropic could at any point come out and say all those are due to third party providers. Why can't it be simply the case that Anthropic is struggling by their own accord? Infra scaling isn't a solved problem, much less with new, complicated, ever-changing, stateful LLM requests. Pretty much every API-service-centric company I've worked at was in some constant state of either triaging or thinking about infrastructure health, often due to the familiar cascading problems of a necessarily distributed system. But now with the AI scapegoat, we rewrite history to pretend us humans solved infra scaling, so any issues today must be caused by AI and any related superstitions we want to tack on. | |||||||||||||||||
| |||||||||||||||||