Remix.run Logo
roncesvalles 2 hours ago

That slot is called USB-C. I can fully imagine inference ASICs coming in powerbank form factor that you'd just plug and play.

ekianjo a few seconds ago | parent | next [-]

Not if you need 200w power to run inference.

zupa-hu 37 minutes ago | parent | prev | next [-]

This would be a hell of a hot power bank. It uses about as much power as my oven. So probably more like inside a huge cooling device outside the house. Or integrated into the heating system of the house.

(Still compelling!)

XorNot 2 hours ago | parent | prev [-]

Pretty sure it'd just be a thumbdrive. Are the Taalas chips particularly large in surface area?

thesz 2 hours ago | parent | next [-]

800 mm2, about 90mm per side, if imagined as a square. Also, 250 W of power consumption.

The form factor should be anything but thumbdrive.

pfortuny an hour ago | parent [-]

mmmhhhhh 800mm2 ~= (30mm)2, which is more like a (biggish) thumb drive.

thesz an hour ago | parent [-]

Thanks!

I haven't had my coffee yet. ;)

dmurray 2 hours ago | parent | prev [-]

The only product they've announced at the moment [0] is a PCI-e card. It's more like a small power bank than a big thumb drive.

But sure, the next generation could be much smaller. It doesn't require battery cells, (much) heat management, or ruggedization, all of which put hard limits on how much you can miniaturise power banks.

[0] https://taalas.com/the-path-to-ubiquitous-ai/