Somewhat relatedly, how do the economics for Huggingface work? They must be hosting petabytes of models and datasets by now. I have downloaded quite a few “just in case”, only to replace them with the later iteration months later.

Does the file hosting actually cost peanuts when you do it yourself and the cloud has shattered my understanding of what it actually costs to deliver so much data?

▲

wongarsu 3 hours ago | parent | next [-]

File hosting is pretty cheap. Egress traffic is about $90/TB in the cloud, but around $1/TB in the real world. Storage is in the realm of $5/TB/month after adding redundancy

At the scale of Huggingface, that still amounts to a lot load of money. Significantly less than if you did the same in AWS, but still a lot

That said, they do have a deal with AWS to make the data available in AWS ip space. Maybe they got some cheap hosting out of that too

▲

oceanplexian an hour ago | parent [-]

It's less than $1/TB. If you have settlement-free peering it's like fractions of a penny at scale. Cloud provider DTO pricing is literally the biggest scam on Earth.

	▲	gandreani an hour ago \| parent [-]
		What does DTO mean in this case? And settlement-free peering? I didn't know the price for S3 could be so cheap with AWS

▲

lima 4 hours ago | parent | prev | next [-]

Bandwidth is really cheap when you run your own infra

	▲	himata4113 3 hours ago \| parent \| next [-]
		It's not only cheap, it's actually free since if you are not using your 95th percentile you are losing money.
	▲	miyuru 3 hours ago \| parent \| prev [-]
		when trying to download models using browser, the DL domain for me us.aws.cdn.hf.co which points to bunch of singapore AWS IPv4 for me, despite it saying US.

▲

jvuygbbkuurx 4 hours ago | parent | prev [-]

Maybe download numbers are relatively low

	▲	rupx 3 hours ago \| parent [-]
		Download numbers are reported on the site, and they aren't low. CDN costs are pennies compared to inference and training though, HuggingFace will just get another 100 million and be set.