Yeah cause every car needs 8xH200 pulling 10kW to run a VLM at realtime speeds. Would be unfortunate if 4G dropped out under some trees while using the API after all.

▲

Marha01 8 minutes ago | parent | next [-]

> Yeah cause every car needs 8xH200 pulling 10kW to run a VLM at realtime speeds.

When the models stop improving, we will get model-specific ASICs that are much more power-efficient.

▲

post-it 2 hours ago | parent | prev [-]

Power usage isn't an issue. 10 kW is 13 HP. The size, price, and fragility of the components is the issue.

	▲	officeplant an hour ago \| parent \| next [-]
		Steady 10KW load means 40 less miles after an hour of driving if your EV gets 4mi/kwh. That kind of draw would use up nearly 1/6th of my EV's battery in an hour.
	▲	AlphaSite an hour ago \| parent \| prev [-]
		GPUs/XPUs are small and solid state so it’s only really price that’s a huge liking factor. And the disinclination of these companies to push the weights of their cutting edge models into people’s cars where they can be dumped.