AI that we have now is not a digital animal in capability or kind, and is not currently anywhere close to taking over.

But it's still in its present form very intelligent in meaningful and useful ways. And it is not too soon to talk about concerns of a potential existential threat in the future. Because it could sooner than we might realize, threaten our existence.

Because of the potential, we should have a culture of caution as we continue to rapidly improve AI.

▲

bilekas 2 days ago | parent [-]

It will only become an existential threat (in my humble opinion) when they can run influenced inference locally offline almost instantaneously. Then we need to be concerned about not being able to switch it off.

▲

ilaksh 2 days ago | parent [-]

What do you mean "influenced inference" almost instantaneously? My laptop from 6 years ago can run an agent in a very fast loop in a web browser. It's not going to take over anything though since it's Gemma 4 E2B with only 2 billion parameters.

	▲	bilekas 2 days ago \| parent [-]
		Fair, then I should add an addendum that today's frontier models, which are very capable of take overs. Your local model doesn't need to take anything over if for an extreme example it was just given an infrastructure system full access, say electricity grid, it wont have the context to create redundant copies of itself but it could easily decide humans don't need electricity anymore. Also I'm not sure your model will have the context to know "it's time to reinfer" especiallynot "on the fly". My phrasing could be better but I'm talking about more powerful models.