Ahhh, so is this a chip "more optimised" for connecting GPU's to reality ... or are they skipping the GPU step entirely? Are GPU's only for training now?

▲

cyanydeez 4 hours ago | parent [-]

have you seen this: https://chatjimmy.ai/

It's quite impressive what purpose build inference can/will do once everyone stops trying to become kind of the best model.

▲

redwood 3 hours ago | parent [-]

Wow impressive. What's the story with this?

	▲	jffry 3 hours ago \| parent \| next [-]
		It's a tech demonstrator for a company that turns models into custom silicon for fast inference. In this case llama3.1-8b https://taalas.com/products/
	▲	hmartin 3 hours ago \| parent \| prev [-]
		Taalas hardware implementation of Llama 3.1 8B They claim 16k tok/s vs Cerbras at 2k. https://taalas.com/products/