I guess I assumed they meant BERT, not some specific BERT-base model. Vanilla BERT does not support zero shot.