Remix.run Logo
alephnerd an hour ago

> U.S. policymakers believe that even if the gap is small—like six months to a year—whoever reaches AGI first...

From past experience, AGI was never seriously discussed in these kinds of conversations beyond thought experiments, and was basically humoring SBF, Daniela Amodei, and the other EA types (some deep believers, but some who I felt were cynically using it as a way to preempt competition back when OpenAI and Google were the behemoths).

The big worry is applications of AI in C4ISR, OffSec, loitering munitions, Disinfo/social media botting (notice the recent shift towards identification on social media ;)), and other sorts of DefenseTech adjacent usecases.

The second worry is that an AI race turns into an infra buildout race, and HPC is extremely dual use, especially in the simulations space because of the NPT, the CTBT, and the PTBT.

The AGI-pilled people aren't the ones to worry about - it's the people who understand the limits of models and how to integrate with cyberphysical applications.