> So it makes sense that you'd just make whites as bright as possible- if the user doesn't like that, they can just turn the brightness down. Otherwise you're just kind of leaving the monitor's available/potential contrast on the table.

No. 70% white backgrounds allowed light and dark contrast elements. 100% white backgrounds do not.