Remix.run Logo
mdaniel 4 days ago

> AWS I know manufactures its own CPUs, but I don't know if they're working on or already have an AI accelerator

I believe those are the Inferentia: https://aws.amazon.com/ai/machine-learning/inferentia/

> AWS Inferentia chips are designed by AWS to deliver high performance at the lowest cost in Amazon EC2 for your deep learning (DL) and generative AI inference applications

but I don't know this second if they're supported by the major frameworks, or what

I also didn't recall about https://aws.amazon.com/ai/machine-learning/trainium/ until I was looking up that page, so it seems they're trying to have a competitor to the TPUs just naming them dumb, because AWS

> AWS Trainium chips are a family of AI chips purpose built by AWS for AI training and inference to deliver high performance while reducing costs.

ants_everywhere 4 days ago | parent [-]

thanks this is useful!

> have a competitor to the TPUs just naming them dumb, because AWS

I kind of like "trainium" although "inferentia" I could take or leave. At least it's nice that the names tell you the intended use case.