The point is that to a player the mapping is more important than the core 12-note structure, because highly chromatic (12-note) passages happen but they are the exception.

At least in western music you pick the seven basic notes on the scale, and that gives you the sharps and flats you place at the beginning of each line. That choice, from the point of view of notation, is even more important than the exact scale. And the choice is constrained to 15 sets of sharps and flats because it implicitly tells the player (veeeery roughly) to expect some patterns that probably will occur.

It doesn't always work great, for example if you want to write the Simpsons theme the set of notes in the scale doesn't fit any of those 15 sets. But it uses an unfamiliar scale in any case, so there's not much to gain and as a player you just deal with it.

See around 32:30 in https://youtu.be/Eq3bUFgEcb4?t=1950