> Why aren't these tests being run airgapped?! I just don't understand! […]

Because Anthropic does not want to give Project Glasswing’s partner airgapped access to the model(s).

Same problem with OpenAI Cyber program. They grant access but only through their (Internet facing) API.