Signal does not use the phone number for anything except account registration
Then why even have it?
To prevent bots from easily creating accounts. Cost-wise it is very effective and non-profits have to make costs manageable.
It was also used for the network effect in the beginning like WhatsApp did.
I still do not like it or the alternative of google/apple pay/services.