13/s is not slow. Q4 is not bad. The models that run on phones are never 30B or anywhere close to that.

lostmsu 5 days ago | parent | next [-]

It is very slow and totally unimpressive. 5060Ti ($430 new) would do over 60, even more in batched mode. 4x RPi 5 are $550 new.

	▲	magicalhippo 5 days ago \| parent [-]
		So clearly we need to get this guy hooked up with Jeff Geerling so we can have 4x RPi5s with a 5060 Ti each... Yes, I'm joking.

5 days ago | parent | prev [-]

[deleted]