Hasn't Anthropic being experiencing issues due to extremely high usage? Being their investor, you would think Amazon wouldn't do Anthropic dirty by weakening their ability to handle user traffic

▲

nateglims 6 hours ago | parent [-]

Amazon runs anthropic models in it's own DCs with Bedrock.

▲

brcmthrowaway 4 hours ago | parent [-]

How does this work?

Anthropic sends .gguf and a claude-serve binary?

	▲	svachalek 3 hours ago \| parent [-]
		GGUF is mostly a hobbyist format, but yeah I'd assume it's a big pile of tensors and and executable.