People have for quite some time been using Googles Tensor chip to accelerate AI workloads on the Pi. I doubt that anyone runs Llms on Pis but stuff like security cameras with object detection...

I read somewhere that Google has largely abandoned support for their Coral TPUs? I still use a Coral TPU for Frigate NVR. But not sure how long they'll be supported.