I go to the conference frequently and know the organizing committee. It depends on the year (2025 and 2026 did it, but not 2024). And if someone decides to register arith20xx.org, I doubt the conference would buy it.

They would just choose a different domain name, it's not that important and the previous years tend to forward link anyway.