I use AMD MI300s at work, and my experience is that for PyTorch at least there is no moat. The moat only exists in people's minds.

Until 2022 or so AMD was not really investing into their software stack. Once they did, they caught up with Nvidia.

▲

imtringued 4 days ago | parent [-]

The only way the average person can access a MI300 is through the AMD developer cloud trial which gives you a mere 25 hours to test your software. Meanwhile NVidia hands out entire GPUs for free to research labs.

If AMD really wanted to play in the same league as NVidia, they should have built their own cloud service and offered a full stack experience akin to Google with their TPUs, then they would be justified in ignoring the consumer market, but alas, most people run their software on their local hardware first.

▲

overfeed 4 days ago | parent | next [-]

> The only way the average person can access a MI300 is through the AMD developer cloud trial which gives you a mere 25 hours to test your software

HN has a blindspot where AMDs absence in the prosumer/SME space is interpreted as failing horribly. Yet AMDs instinct cards are selling very well at the top end of the market.

If you were trying to disrupt a dominant player, would you try selling a million gadgets to a million people, or a million gadgets to 3-10 large organizations?

▲

FuriouslyAdrift 4 days ago | parent | prev | next [-]

AMD sells 100% of the chips they can produce and at a premium. It's chicken and the egg, here. They have to compete with nVidia for pre-buying fab capacity at TSMC and they are getting out bought.

	▲	tonyhart7 4 days ago \| parent [-]
		AMD also need to share that fab wafer capacity to processor division and third party client like (sony,valve,various hpc client)

▲

Cheer2171 4 days ago | parent | prev [-]

I can rent an MI300X for $2.69/hr right now on runpod.