| ▲ | rootnod3 2 hours ago | |||||||
Sorry what? "You can't measure my Cloud Service's performance correctly if my servers are overloaded"? "Oh, you just measured me at bad times each day. On only 50 different queries." So, what does that mean? I have to pick specific times during the day for Claude to code better? Does Claude Code have office hours basically? | ||||||||
| ▲ | johnsmith1840 29 minutes ago | parent | next [-] | |||||||
This has been happening for years. Tgere's a great paper from microsoft on Deepspeed AI inference. Basically the paper showed methods for how to handle heavy traffic load by changing model requirements or routing to different ones. This was awhile ago and I'm sure it's massively more advanced now. Also why some of AI's best work for me is early morning and weekends! So yes, the best time to code with modern LLM stacks is when nobody else is. It's also possibly why we go through phases of "they neutered the model" some time after a new release. | ||||||||
| ▲ | copilot_king 2 hours ago | parent | prev [-] | |||||||
> Does Claude Code have office hours basically? Yes. Now pay up or you will be replaced. | ||||||||
| ||||||||