▲ | mdaniel 4 days ago | |
> AWS I know manufactures its own CPUs, but I don't know if they're working on or already have an AI accelerator I believe those are the Inferentia: https://aws.amazon.com/ai/machine-learning/inferentia/ > AWS Inferentia chips are designed by AWS to deliver high performance at the lowest cost in Amazon EC2 for your deep learning (DL) and generative AI inference applications but I don't know this second if they're supported by the major frameworks, or what I also didn't recall about https://aws.amazon.com/ai/machine-learning/trainium/ until I was looking up that page, so it seems they're trying to have a competitor to the TPUs just naming them dumb, because AWS > AWS Trainium chips are a family of AI chips purpose built by AWS for AI training and inference to deliver high performance while reducing costs. | ||
▲ | ants_everywhere 4 days ago | parent [-] | |
thanks this is useful! > have a competitor to the TPUs just naming them dumb, because AWS I kind of like "trainium" although "inferentia" I could take or leave. At least it's nice that the names tell you the intended use case. |