The Matter devices (a smart bulb or a sensor) have no Internet access required by the spec, and no way to send telemetry to the Internet.

It’s the commissioners that check for the certification: your phone or an open source implementation.

And the commissioners can, explicitly by the specification, commission other devices while completely offline.