That's actually pretty cool, but I'd hate to freeze a models weights into silicon without having an incredibly specific and broad usecase.

▲

patapong 4 hours ago | parent | next [-]

Depends on cost IMO - if I could buy a Kimi K2.5 chip for a couple of hundred dollars today I would probably do it.

▲

4 hours ago | parent | prev | next [-]

[deleted]

▲

whatever1 3 hours ago | parent | prev | next [-]

I mean if it was small enough to fit in an iPhone why not? Every year you would fabricate the new chip with the best model. They do it already with the camera pipeline chips.

▲

superxpro12 3 hours ago | parent | prev [-]

Sounds like just the sort of thing FGPA's were made for.

The $$$ would probably make my eyes bleed tho.

	▲	chrsw 3 hours ago \| parent \| next [-]
		Current FPGAs would have terrible performance. We need some new architecture combining ASIC LLM perf and sparse reconfiguration support maybe.
	▲	0x457 2 hours ago \| parent \| prev [-]
		Wouldn't it be the opposite of freezing weights?