I don't get this. It's not like the models are running on their own GPUs.

So if you're running open models on AWS GPUs, you might as well run Claude (which AWS supports, and doesn't share any data with Anthropic).

Same with Azure/OpenAI.

monegator 4 hours ago | parent | next [-]

> (which AWS supports, and doesn't share any data with Anthropic)

I want to believe (pinky promises from terms of service don't count)

	▲	criemen 3 hours ago \| parent [-]
		If you don't believe AWS follows their ToS, you shouldn't use any cloud provider for CPU/data storage/anything else either. That's not a mainstream position in the industry.

abalashov 2 hours ago | parent | prev | next [-]

> which AWS supports, and doesn't share any data with Anthropic

Ah... oh.

Well, it's a nice thought.

Sufficiently large enterprises could get their own GPUs to run the models though.

	▲	hobofan 2 hours ago \| parent [-]
		As long as you don't have "realtime" workloads, owning the GPUs quickly becomes the economical option. The main cost problems is in e.g. chat applications where the workload is spikey, and users expect an near-instant response, for which you need to scale the GPUs to the highest spikes of the workload.