This is yet another reason why I think local models will win in the future. They're almost certainly A/B testing all sorts of opaque stuff that people have no clue about, hence the various 'How's Claude doing this session?' popups.

So what you are paying for may vary on a day by day basis, which is quite undesirable, even if their main goal is simply to make a better model. When it comes to a tool, I'd rather have consistent mediocrity than instability.