Anthropic, if you're listening - by the time this crops up on Reddit, the front page of HN, etc.... you should be expecting calls from CEOs of major corporations next threatening to abandon ship...

We've seen this pattern before several times.. I hope they are listening and address this publicly.

I'm not sure what is going on, some users report it works fine or great, others report the degradation. I've experienced both at times, and it's been such a different experience it has made me wonder if there isn't some sort of hidden A/B test or model router in the background silently downgrading requests at times.

Also, regarding the subsidized access to models, in my opinion, the frontier companies owe it to society to continue it. After mining the public content of all of humanity, I personally feel it is a service they owe the public in return.. not that my feeling of this counts for anything though.

▲

zarzavat an hour ago | parent | next [-]

You are expecting consistent QoS from a randomly sampled mathematical function.

	▲	sixdimensional an hour ago \| parent \| next [-]
		This is a fair comment, although I would add that is not my expectation personally. I think nondeterminism does not have to be the same as non-coherency - i.e. just because something is randomly sampled does not mean the result has to be incoherent or inconsistent. Also, if we speak purely about LLM based on how they are implemented now, I feel that is different than speaking about artificial intelligence. The field of AI is much more than just an LLM by itself, and the promise of these companies is not just LLM, whether the underlying models are limited to that technology or not. FWIW, I have built rule based expert systems, used logic based reasoning systems like NASA CLIPS or rete-algorithm based systems, mathematical/symbolic solvers, written plenty of terrible case/conditional logic in programming languages, worked with ML in its infancy and now worked in AI/LLMs - I give this context only to clarify that I understand what an LLM is and isn't. With all that said, LLMs have allowed humanity to make advances, at great cost to society (IMHO), and I'd hate to see the opportunity be wasted. There is plenty of room past "attention is all you need" still to do incredible work, especially at the crossroads between deterministic and nondeterministic behaviors.
	▲	lordgilman an hour ago \| parent \| prev [-]
		True, but this function wasn't handed down to us from the gods, it can be shaped by training and RLHF processes. They still have a little bit of control over its output.

▲

repeekad an hour ago | parent | prev [-]

> owe it to society

In America? lol if only, only a law would get them to act for that reason, maybe not even that these days..

	▲	sixdimensional an hour ago \| parent [-]
		Or, maybe competition.. but your point is taken. I like to hope that those in positions of power do have a sense of morality though too.. but their worldview is quite different than an ordinary citizen.