Very cool! I have been using Lean to drive PJRT like so: https://github.com/brettkoonce/lean4-mlir and in theory your code could unlock another platform!

This is super cool!

Pytorch conference is happening today for explaining the coincidental timing

Yes. Google is famously selling TPUs on prem to big customers (e.g., Anthropic) and Crux AI is now a venture to do just that.

Maybe just marketing, but they call the NPUs in their Pixel phones "TPUs"

Google coral USB and m.2 devices are TPUs.

TPU / neural compute accelerator / Math coprocessor;

"OpenTPU: Open-Source Reimplementation of Google Tensor Processing Unit (TPU)" https://news.ycombinator.com/item?id=44111452

From https://news.ycombinator.com/item?id=45848676 :

> How does Cerebras WSE-3 with 44GB of 'L2' on-chip SRAM compare to Google's TPUs, Tesla's TPUs, NorthPole, Groq LPU, Tenstorrent's, and AMD's NPU designs?

There are TPUs made out of silicon carbide with standard fab.

There is in-flight tensor processing with photons, but that's not quite a TPU.

hardware has always been the moat in the AI space

Products can also be a moat.

it doesn't seem like there's an abundance of shovels coming anytime soon

I dont think big companies like Google react to news like that. Very likely this was meant to go out on Tuesday for weeks now. And it just happened to have coincided with another news.

Yeah they read the news this morning and whipped up a quick Torch->XLA translation layer and coordinated with four different inference engines (who also all wrote their own blog posts) and shoved this out the door quick to stay on top of the news cycle

No, these are two very different objectives.

They do different things and sit in different parts of the stack (training vs inference). TorchTPU seems more like a play to get more people familiar with Googles TPU chips as they want to sell them to people outside of google.

lol no this is a replacement for https://github.com/pytorch/xla