Phones should have separate storage for their OS so that when you buy a specific phone with specific storage it actually is that much storage available to the user

Android used to work kinda like that. You got the system partition that's a fixed size, and that's it. You also had the data partition for apps and their data on the same internal flash. For everything else, you inserted a micro SD card. You could move some apps to the SD card as well.