Remix.run Logo
danpalmer an hour ago

S3 is also 10x more expensive than this single consumer grade second hand hard drive I have.

Managed NAT gateways are also 10000x more expensive than my router.

This is a boring argument that has been done to death.

oersted 44 minutes ago | parent | next [-]

As a CTO of a number of small startups, I am still struggling to understand what exactly AWS and other cloud providers give you to justify the markup.

And yes we’ve been heavy users of both AWS and Google Cloud for years, mainly because of the credits they initially provided, but also used VMs, dedicated servers and other services from Hetzner and OVH extensively.

In my experience, in terms of availability and security there’s not much difference in practice. There are tons of good tools nowadays to treat a physical server or a cluster of them as a cloud or a PaaS, it’s not really more work or responsibility, often it is actually simpler depending on the setup you choose. Most workloads do not require flexible compute capability and it’s also easy to get it from these cheaper providers when you need to.

I feel like the industry has collectively accepted that Cloud prices are a cost of doing business and unquestionable, “nobody got fired for choosing IBM”. Thinking about costs from first principles is an important part of being an engineer.

aurareturn 40 minutes ago | parent | next [-]

When your cheap dedicated server goes down and your admin is on holiday and you have hundreds of angry customers calling you, you'll get it.

Or you need to restore your Postgres database and you find out that the backups didn't work.

And finally you have a brilliant idea of hiring a second $150k/year dev ops admin so that at least one is always working and they can check each other's work. Suddenly, you're spending $300k on two dev ops admins alone and the cost savings of using cheaper dedicated servers are completely gone.

isoprophlex 4 minutes ago | parent | next [-]

When your AWS bill suddenly spikes to $69k because some data science intern left a huge gpu backed EC2 instance running in ap-southeast-2 with a misconfigured auto-scaling group, and your CTO is at a "digital transformation" conference, and you have hundreds of angry investors asking why your burn rate tripled, you’ll get it.

Or you need to debug why your Lambda function is throttling and you find out that the CloudWatch logs were never properly configured and you’ve been flying blind for three months.

And finally you have a brilliant idea of hiring a second $150k/year AWS solutions architect so that at least one person can actually understand the bill and they can check each other’s Terraform configs. Suddenly, you’re spending $300k on two cloud wizards alone and the cost savings of "not managing your own infrastructure" are completely gone.

The snide rebuttal basically writes itself.

tiew9Vii 10 minutes ago | parent | prev | next [-]

> When your cheap dedicated server goes down and your admin is on holiday and you have hundreds of angry customers calling you, you'll get it.

Or when you need to post on Hackernews to get support from your cloud provider as locked out of your account, being ignored and the only way to get access is try to create as much noise as possible it gets spotted.

Or your cloud provider wipes your account and you are a $135B pension fund [1]

Or your cloud portfolio is so big you need a "platform" team of multiple devops/developer staff to build wrappers around/package up your cloud provider for you and your platform team is now the bottleneck.

Cloud is useful but it's not as pain free as everyone says when comparing with managing your own, it still costs money and work. Having worked on several cloud transformations they've all cost more and taken more effort than expected. A large proportion have also been canned/postponed/re-evaluated due to cost/size/time/complexity.

Unless you are a big spender with dedicated technical account manager, your support is likely to be as bad as a no name budget VPS provider.

Both cloud and traditional hosting have their merits and place.

[1] https://arstechnica.com/gadgets/2024/05/google-cloud-acciden...

grey-area 34 minutes ago | parent | prev | next [-]

It is statistically far more likely that your cloud service will go down for hours or days, and you will have no recourse and will just have to wait till AWS manage to resolve it.

n4r9 19 minutes ago | parent | next [-]

I suspect that this is really about liability. When AWS goes down you can just throw up your hands, everyone's in the same boat. If your own server goes down you worry that your customers doubt your competence.

whstl a few seconds ago | parent [-]

So it finally has come to this.

AWS is not cheap, it's not fast, it's complicated, is's unpredictable, it requires very expensive employees to run, and now is not even reliable anymore.

But people use it because you can blame them.

aurareturn 31 minutes ago | parent | prev [-]

The difference is that if AWS goes down, I know for a fact that it'll be back up without me doing anything.

If my own dedicated server goes down, I'm going to need to call my admin at 3am 10 times just to wake him up.

oersted 23 minutes ago | parent | prev | next [-]

After 8 years operating like this, I have had approximately the same number of critical outages in standard Cloud as with these providers.

One included a whole OVH building burning down with our server in it, and recovery was faster than the recent AWS and Cloudflare outages.

If you want to, these providers also offer VMs, object storage and other virtualized services for way cheaper with similar guarantees, they are not stuck in the last century.

And I don’t know how people are using cloud, but most config issues happen above the VM/Docker/Kubernetes level, which is the same wether you are on cloud or not. Even fully managed database deployments or serverless backends are not really that much simpler or less error-prone than deploying the containers yourself. Actually the complexity of Cloud is often a worse minefield of footguns, with their myriad artificial quirks and limitations. Often dealing with the true complexities of the underlying open-source technologies they are reselling ends up being easier and more predictable.

This fearmongering is really weakening us as an industry. Just try it, it is not as complex or dangerous as they claim.

aurareturn 20 minutes ago | parent [-]

I'm a geek and I like to tinker with hardware. I want to maximum my $/hardware and have built a ton of DIY computers myself since I was young. I'm all about getting the most hardware for the money.

But I'd like to sleep at night and the cost of AWS is not a significant issue to the business.

oersted 9 minutes ago | parent [-]

That’s fair enough but that’s a luxury position, if costs are not concern to you then there’s not much point in discussing the merits of different methods to manage infrastructure efficiently.

And yes of course such costs are nothing if you are thinking of $300K just on a couple sysadmins. But this is just a bizarre bubble in a handful of small areas in the US and I am not sure how it can stay like that for much longer in this era of remote work.

We built a whole business with $100K in seed and a few government grants. I have worked with quite a few world-class senior engineers happily making 40K-70K.

Perz1val 34 minutes ago | parent | prev | next [-]

That's even worse when AWS goes down and myth of it never going down should be more than shattered by now

esseph 34 minutes ago | parent | prev | next [-]

Sure, but AWS has more downtime than I do :-)

aurareturn 27 minutes ago | parent [-]

Yes but you go on holidays but AWS does not.

juliusceasar 32 minutes ago | parent | prev | next [-]

When your system goes down on AWS and your AWS admin is on holiday, you'll have the same problem.

What is your point?

wink 25 minutes ago | parent | next [-]

Every team I have worked on so far, if using AWS you had 50-100% of the developers with the knowledge and credentials (and usually the confidence) to troubleshoot/just fix it/replace it.

Every team with dedicated hardware in a data center it was generally 1-2 people who would have fixed stuff quickly, no matter the size of the company (small ones, of course - so 10-50 devs). And that's with available replacement hardware.

I'm not even one of the "cloud is so great" people - but it you're generally doing software it's actually a lot less friction.

And while the ratio of cost difference may sound bad, it's generally not. Unless we're talkign huge scale, you can buy a lot of AWS crap for the yearly salary of a single person.

aurareturn 26 minutes ago | parent | prev [-]

I don't have an AWS admin. I assume a $2.4 trillion dollar company always has dev ops on call?

bjourne 23 minutes ago | parent | prev [-]

What prevents an EC2 instance from going down in exactly the same way? Other hosting providers offer automatic backup too - it's not an AWS exclusive feature.

aurareturn 19 minutes ago | parent [-]

Nothing. It's just that I'm not the one responsible to fix it at 3am.

mgaunard 41 minutes ago | parent | prev | next [-]

What AWS gives you is the ability to spin up dozens if not thousands of hosts in a single click.

If you run your own hardware, getting stuff shipped to a datacenter and installed is 2 to 4 weeks (and potentially much longer based on how efficient your pipeline is)

tempestn 30 minutes ago | parent | next [-]

If you own your own hardware, but you can provision a leased dedicated server from many different providers in an hour or three, and still pay far less than for comparable hardware from AWS.

mgaunard 23 minutes ago | parent [-]

That sounds like a good deal, what providers offer this?

graemep 3 minutes ago | parent [-]

OVH, Hetzner, Scaleway. Lots of smaller providers. Most people who offer dedicated servers do this.

noir_lord 28 minutes ago | parent | prev | next [-]

Which is an awesome capability, if you need it.

I suspect that if you broke projects on AWS down by the numbers, the vast majority don't needed it.

There are other benefits to using AWS (and drawbacks) bit "easy scaling" isn't just premature optimisation because if you build something to do something it's never going to do that's not optimisation it's simply waste.

mgaunard 24 minutes ago | parent [-]

They need it at the beginning to get started quickly, then they don't but don't bother moving out.

Not too different from how many other lines of business get their clients in the door.

continuational 35 minutes ago | parent | prev [-]

But on Hetzner, you can usually get a dedicated server installed and ready tomorrow.

h33t-l4x0r 26 minutes ago | parent [-]

Hetzner is oversold. It's not appropriate for production in the same sense that EC2 obviously is. It's fine for staging though.

peanut-walrus 32 minutes ago | parent | prev [-]

It makes sense to think about price in the context of your business. If your entire infra cost is a rounding error on your balance sheet, of course you would pick the provider with the best features and availability guarantees (choose IBM/AWS). If your infra cost makes up a significant percentage of your operating expenses, you will start spending engineering effort to lower the cost.

That's why AWS can get away with charging the prices they do, even though it is expensive, for most companies it is not expensive enough to make it worth their while to look for cheaper alternatives.

tempestn 32 minutes ago | parent | prev | next [-]

There's a distinction between just saying it's more expensive and saying it's slower at the same price. Compared to well spec'ed and administered dedicated servers, it's basically impossible to get the same performance from AWS (or other cloud services) at any price. Yes, there are advantages, scaling being the greatest one. But you won't get the same raw speed you can achieve with fast storage and processing in a single machine (or a tight network) through cloud services—probably at all, but certainly not for anywhere near the same price.

And if you are willing to pay, you can significantly over-provision dedicated servers, solving much of the scaling problem as well.

kachapopopow 22 minutes ago | parent | prev | next [-]

nat gateways not being free is criminal.

dainiusse an hour ago | parent | prev [-]

"AWS inflation"