I think so, yes.
However, it might have fewer restrictions than a BERT and/or is smarter (whatever that means).