Remix.run Logo
pclmulqdq 6 days ago

I'm still not sure why anyone would buy a dell server. Supposedly xAI buys from them, which probably accounts for this, but it is generally a much more sensible choice to buy from companies that are lower-cost and less focused on selling you "enterprise support" (supermicro et al).

electroly 6 days ago | parent | next [-]

Nobody ever got fired for buying Dell with ProSupport. I buy Dell servers at work because it's not my money but it is my ass on the line if something goes wrong. The quotes you get from your rep look nothing at all like the retail pricing on Dell's website.

jjice 6 days ago | parent [-]

Is this the support I've heard about from Dell? I've always heard about it from a consumer perspective, but I've been told that they'll come out to you same or next day for hardware support? If that's the case, that's pretty damn impressive.

criddell 6 days ago | parent | next [-]

My daughter took her Alienware laptop to school with her. The keyboard broke and we contacted Dell support hoping to just buy a new keyboard. Instead, they sent a technician to her dorm next day who fixed it on-site.

What really impressed me was that we bought the laptop in the US where we live and she was going to school in Canada.

jlund-molfese 6 days ago | parent [-]

That’s really cool! Was this just with the standard warranty, or did you have to get some sort of extended support plan?

criddell 6 days ago | parent | next [-]

It was the standard warranty which makes me think there was a known flaw in those keyboards.

Interestingly, I got nowhere with phone support. The support person told me there were no keyboards available and didn't know when it would be back in stock. So then I contacted Dell support on Twitter (as it was known back then) and they immediately got back to me to find out what happened and arranged the repair.

the_pwner224 6 days ago | parent | prev [-]

Their higher end consumer models come with ProSupport as the standard warranty.

electroly 6 days ago | parent | prev | next [-]

Yes, they have both next-day and same-day on-site support plans. For hardware failures they will bring the part to your office/data center and perform the replacement. We're in a third party colocation facility and Dell is happy to dispatch techs there; we don't have to be present.

tracker1 6 days ago | parent [-]

Had this for a work laptop a few years ago... That said, I think it was a design flaw in that model, had to have the MB replaced twice under warranty, the third time it was out of warranty and I just got assigned a new laptop.

throwup238 6 days ago | parent | prev | next [-]

Both consumer and enterprise hardware has that level of on-site support. Even for the consumer side Dell contracts out to a bunch of local IT technicians that drive around fixing stuff. I remember a tech sitting in my living room swapping out a (consumer) laptop screen all the way back in 2007 so they’ve had this support for a long time.

ocdtrekkie 6 days ago | parent | prev [-]

ProSupport isn't just excellent warranty coverage, often adding Plus (accidental damage) is not expensive either. Laptop literally run over by a car? Dell fixes or replaces it.

There are funny aspects too, we had a laptop with a broken rubber handle and Dell didn't have the available part, or replacement laptops of the same model, so they gave us an equivalent system a three years newer model.

At the desktop tier Dell Command Update is probably just the best driver/firmware update tool for a business.

Their server side can be a harder sell, it's a lot pricier than competitors sometimes without a ton of justifiable benefit for choosing them.

alephnerd 6 days ago | parent | prev | next [-]

> buy from companies that are lower-cost and less focused on selling you "enterprise support" (supermicro et al).

From past experience, vendors like SuperMicro aren't much cheaper at scale because Dell can give 80% discounts on volume, and most Dell server sales are done via Channel with an MSP who will manage and administer the system.

Ofc, this continues to reinforce my belief that the "AI boom" in it's current form (and once you remove the scooby doo monster mask) is basically a "Datacenter/Telecom Bubble" 2.0 like back in 2000-01. The multiples, messaging, vendors, and margins are almost the exact same.

During the Dot-com Boom, Telecom and hardware companies were also expanding DC and telecom capacity massively (to surf and host a website on the Internet, you kinda need Internet and web hosting), and when the Dotbomb happened, the Telco bubble collapsed subsequently as well (remember WorldCom/MCI?)

That's why the 2000s were horrible for anyone with a CS/CE/CSE/EE degree, because both software AND hardware industries collapsed. Imagine a world in the late 2020s where you cannot land a job as a Fullstack Engineer OR an ML Infra Engineer - that was the 2000s except with older stacks.

That's also why I'd be optimistic if a bust happens - the overcapacity in compute that arose from the Telecom and Dot-Com Busts both helped usher the Cloud, SaaS, E-Commerce, and Social Media boom because the infra has been laid and became cost effective. It is also in this context that Paul G's "cockroach" and "ramen profitability" essay came to the fore.

oblio 6 days ago | parent | next [-]

The thing is, the bust froze everything for 1 or 2 years, which sucked for regular IT folks plus this time there also a huge oversupply of IT graduates. I wouldn't be surprised if there are 10x more people working in IT then back then.

alephnerd 6 days ago | parent [-]

Mind you, I was just a kid when it happened so I'm basing it off of 2nd hand stories, but my understanding was anyone with a pulse (ie. A hs grad or a college dropout) could get hired into the industry at the time (eg. The KOTH joke that if Peggy was laid off from being a substitute teacher she'd learn to design software).

At least ime in the 2010s and 2020s, while you had some aspect of that with bootcamp grads, it wasn't to the same degree. Or was it? Like I said, I was a kid when the busts happened so I have no frame of reference.

shermantanktop 6 days ago | parent [-]

I had a pulse and got into this industry in the 90s through the back door.

It’s been a long run and I’ve seen busts come and go. It’s worked out really well for me, even while I’ve watched a surprising number of highly-credentialed new hires flop out over the years. I continue to appreciate people with oddball resumes.

tracker1 6 days ago | parent [-]

Similar here, no formal higher education starting in the early-mid 90's, just a lot of reading/learning and experimenting along the way... Even while working, I've spent 15-20 hours a week most of my career on learning activities.

Somewhat hardware oriented and worked a few tech support/helpdesk and internal IT jobs in the early-mid 90's when I got more into programming as a side-step from design/art.

ToucanLoucan 6 days ago | parent | prev | next [-]

Also anecdotally: back in my sysadmin days, the Supermicros we had had so many more problems than the Dells. Granted this was 2012-2015 era hardware being run in 2018, so I can't say for certain if that's even remotely still true, but yeah.

The 'Micro's ethernets were all shot by the time we closed up shop so each had an expansion card for 10G ethernet at that point, and one we had to run VM management on 10G because the 1G we used elsewhere had shit the bed in that unit somewhere along the way and we couldn't be bothered to buy yet another card and tear down the server again for it. Plus management traffic was negligible.

I don't miss that job. Fuck being on-call.

firesteelrain 6 days ago | parent | prev [-]

> That's why the 2000s were horrible for anyone with a CS/CE/CSE/EE degree, because both software AND hardware industries collapsed

Odd, anecdotally I remember people saying that, but had no issue getting a job in 2004 as a fresh CS grad.

xp84 6 days ago | parent | next [-]

Also anecdotally: by 2006 I also don't think it was that hard, in SF. 2008 of course kicked off a new cycle of capital scarcity, but, what it seemed like to me was that two gold rushes kicked off in earnest around that time which in tech seemed to mitigate any major difficulties for software people: First the online/Facebook gaming goldrush (Zynga being the poster child, but there were dozens more publishers, advertising and monetization firms drinking from that trough) and of course the App Store goldrush.

no_wizard 6 days ago | parent [-]

In 2008 I remember being in tech was able to largely ignore the recession that everyone else was getting reamed by because mobile, Facebook games and generally social media, and general Web 2.0 was getting big investment across the board. The low hanging fruits still had not all been plucked.

If I had been smarter I would have bought up property at what I now know were the lowest prices I’d ever see, but alas, I did not

alistairSH 6 days ago | parent | prev [-]

Having started my career in 1999 (and if you could spell C++, you were pretty well guaranteed at job at a good salary), I remember two things...

- 2000-20001 - "small" recession, along with the dot-com bubble bursting. Lasted through 2003 or so, though the bulk of job loss (across industries) was 2001 into 2002.

- 2008-2010 - housing market collapse - world-wide impact. Most of us probably remember that period. It as brutal for everybody, not just STEM grads. Too big to fail and all that hocus-pocus.

I was RIF'ed in Dec 2001, took a few months to find a job I wanted, but wasn't all that bad given I was pretty darn junior at the time.

tracker1 6 days ago | parent [-]

Yeah, I was/am in Phoenix where it seemed to trail about 8 months... it totally dropped here after 9/11 though. I remember effectively having the plague looking for work through 2002. Was working pretty regularly again by the end of 2003 though... those were a couple rough years though.

alistairSH 6 days ago | parent [-]

DC metro here. My initial job hunting in early 2002 was rough - lots of laid off contractors and dot-com folk. Job fairs were a total bust - too many people to get noticed, especially as a junior dev without any .gov contracting experience (no TS/poly etc).

Got a few interviews and offers in the defense industry, but the lack of TS/poly was a killer - even companies that were willing to do the paperwork had deadlines and Uncle Sam couldn't process request fast enough so a few offers died on the vine.

Eventually got a job through a friend (usually how it works, IME) and have been here ever since. Not .gov, but sort of government-adjacent (higher ed) so still a bit protected from the vagaries of the market and moneymen's whims.

jandrewrogers 6 days ago | parent | prev | next [-]

At scale, the savings of slightly cheaper hardware is often dwarfed by supply chain management costs, both direct and indirect. How much is it worth to your business to get the hardware deployed six weeks sooner and/or with a high probability of timely delivery? I imagine xAI wanted to move with maximum speed.

This is a big part of the decision process. North American supply chains are slightly more expensive but also fast and responsive. The advantage of someone like Dell is also that they can do almost everything in-house, which avoids the overhead (to the business) of coordinating integration of components manufactured in Taiwan, the US, etc into the final build. I’ve done it both ways. There are real tradeoffs so context matters.

pclmulqdq 5 days ago | parent [-]

I am pretty sure that at scale, the savings is so great that this is when you will tolerate a worse experience for cheaper gear. Hence Google and Facebook pinching pennies.

The advantage of buying Dell (or IBM) is that if you aren't buying enough computers to have your own dedicated people, you get someone to take care of you. Dell may be able to get you stuff faster, but the Taiwanese shops are also very good at having an agile supply chain.

dfox 6 days ago | parent | prev | next [-]

My experience with Dell is that they are not that focused on selling enterprise support (at least compared to HPE), at most they will push for bundling hardware (cables, cable trays, front covers, PERC...) that you do not really need in order to get better volume discount.

Price-wise I don't see a meaningful difference between Dell and SuperMicro (or even "non-traditional" server vendors like Asus and Gigabyte).

jaas 6 days ago | parent | prev | next [-]

We buy them because our experience is that they are extremely reliable and their iDrac management system is better than the alternatives, which saves us time (thus money). Maybe they aren’t the cheapest at initial purchase, but less maintenance and the ease of administration makes up for it.

throwaway48476 6 days ago | parent | prev | next [-]

Probably iDrac. AI servers are mostly just white boxed nvidia reference designs. Not much markup.

bluedino 6 days ago | parent [-]

HPE is finally moving away from their 'Cray' systems which are just whitebox AMI systems. You get none of their iLO etc even though they are 'HPE'

psds2 6 days ago | parent | prev | next [-]

In todays market I think there is a lot more consideration to speed of delivery over price. Dell has historically been NVIDIAs #1 OEM partner so it would not surprise me if Dell has supply chain advantages over other server vendors.

cge 6 days ago | parent | prev | next [-]

For academia, I've found that Dell seems to seek and get sole-supplier contracts with universities, so research groups are forced to use their grant money to buy from Dell, often at inflated costs.

moondev 6 days ago | parent | prev | next [-]

To me the OOB/BMC interface of the server is the main tangible difference not the support contract implementation.

IDRAC is miles ahead of SMC/MEGARAC. It's not even close.

axus 6 days ago | parent | prev | next [-]

For the international hardware warranty transfer.

bluedino 6 days ago | parent | prev [-]

You want enterprise support. GPU quality is atrocious, you will have your Dell tech in there replacing GPUs and fans all the time.

c0balt 6 days ago | parent | next [-]

Can second this, the amount of GPU failures we have with Lenovo systems on just <50 nodes is significantly higher than we expected. Having a Lenovo support person at least twice a month on premise at the middle of the bathtub curve is probably also costing them (and implicitly us) a good chunk of money.

grubbs 6 days ago | parent | prev [-]

Interesting. I work in higher ed and we have thousands of GPUs under my team. Rarely ever seen a failure. Mostly when we put consumer grade GPUs in servers (Nvidia doesn't like this). True server-grade GPUs never have any problems.

ecshafer 6 days ago | parent | next [-]

IS this for some kind of HPC cluster? What kind of utilization are you at? For an AI company these GPUs are going to be at near 100% utilization 24/7. These kinds of loads destroy hardware quick.

bluedino 6 days ago | parent | prev [-]

Every site I've worked at has plenty of GPU failures. Not consumer grade either, H100/A100