You are heavily mixing freedom with access to opportunity. They are not the same.

I come from an Eastern European country. Before 1990, if I would have wanted to not study and only drink and let my live go like Diogenes, that would have never worked. The authorities would pick me up from the street and forcefully make me go work something, even if I don't like it. Even if I have studied, the authorities still may decide where I can go to work. The possibility to decide how I can build or fuck up my own live - this is what I understand as freedom.

Opportunity - this is something very different. And to that I can agree with you about the "white skinned man", even if it is very far away from my understanding about the world because of where I was born and how I lived.