> edge AI deployment

Isn't the "edge" meant to be computing near the user, but not on their devices?

stingraycharles 13 hours ago | parent | next [-]

No it does not. This is about as “edge” as AI gets.

In a general sense, edge just means moving the computation to the user, rather than in a central cloud (although the two aren’t mutually exclusive, eg Cloudflare Workers)

▲

pgt 13 hours ago | parent | prev | next [-]

Your device is the ultimate edge. The next frontier would be running models on your wetware.

	▲	elcritch 13 hours ago \| parent \| next [-]
		Not just running it on your wetware, but charging you for it. Can't wait until AI companies go from mimicking human thought to figuring how to licensing those thoughts. ;)
	▲	acters 13 hours ago \| parent \| prev [-]
		Man can't wait for AI in my brain. And then intelligence will be pay to win.

▲

hhh 13 hours ago | parent | prev | next [-]

It depends, because edge is a meaningless term and people choose what they want for it. In 2022, we set up a call with a vendor for ‘edge’ AI. Their edge meant something like 5kW, and our edge was a single raspberry pi in the best case.

▲

davidmurdoch 10 hours ago | parent | prev [-]

For sure. 1000%. Anyone disagreeing with this has lost their marbles.

For those that have lost their marbles: sure, people use words incorrectly, but that does mean we all have to use those words incorrectly.

In compute vernacular, "edge" means it's distributed in a way that the compute is close to the user (the "user" here is the device, not a person); "on device" means the compute is on the device. They do not mean the same thing.