Will the pre-installed GrapheneOS phones still show up as "rooted" to things like Microsoft Authenticator?

Depends how they implement their check, but if they do it correctly it would show the bootloader as locked and detect no su binary (no root).

If they use Google SafetyNet to basically block everything non-Google-certified™ then no.