Remix.run Logo
hgoel 2 hours ago

Makes me think of the demo from some time ago where someone got a ~29M parameter model running on an esp32. I wonder what kind of throughput this could get if a handful of esp32s were strung together...

Edit: I have a pile of d1 minis, but not much time.

forsalebypwner 2 hours ago | parent | next [-]

They mention that this specific model is able to run on an ESP32-S3, or an ESP32-P4 which has 32MB of PSRAM. I'm trying to figure out how to do this now.

HenryNdubuaku 2 hours ago | parent | prev [-]

That demo was Needle 1 indeed and we are creating the guide for ESP32 now as we speak.