Current Waymos do use the transformer architecture, they're still predicting tokens.