Remix.run Logo
tecleandor 13 hours ago

I think it's been calculated that data transfer is the biggest margin product in all AWS catalog by a huge difference. A 2021 calculation done by Cloudflare [0] estimated almost 8000% price markup in EU and US regions.

And I can see how, in very big accounts, small mistakes on your data source when you're doing data crunching, or wrong routing, can put thousands and thousands of dollars on your bill in less than an hour.

--

  0: https://blog.cloudflare.com/aws-egregious-egress/
wiether 12 hours ago | parent [-]

> can put thousands and thousands of dollars on your bill in less than an hour

By default a NGW is limited to 5Gbps https://docs.aws.amazon.com/vpc/latest/userguide/nat-gateway...

A GB transferred through a NGW is billed 0.05 USD

So, at continuous max transfer speed, it would take almost 9 hours to reach $1000

Assuming a setup in multi-AZ with three AZs, it's still 3 hours if you have messed so much that you can manage to max your three NGWs

I get your point but the scale is a bit more nuanced than "thousands and thousands of dollars on your bill in less than an hour"

The default limitations won't allow this.

tecleandor 3 hours ago | parent [-]

That's a NAT gateway, but if you're pulling data for analysis from S3 buckets you don't have those limitations.

Let's say they decide to recalculate or test a algorithm: they do parallel data loading from the bucket(s), and they're pulling from the wrong endpoint or region, and off they go.

And maybe they're sending data back, so they double the transfer price. RDS Egress. EC2 Egress. Better keep good track of your cross region data!