Interesting, Amazon doing the same for AWS Trainium.
https://github.com/aws-neuron/torch-neuronx
Pytorch conference is happening today for explaining the coincidental timing
That explains the 5x speed increases huggingface mentioned for Mac using metal.
Link?