To prevent Chrome from automatically downloading the model, go to Settings → On-device AI.