I am not surprised.

AI works by learning patterns. So it will become bias by just learning from factors like education history, schools attended, employment history, ZIP codes, or geographic location. Those 3 factors alone are an easy proxy for race.

And if you add names into the equation (if the AI was trained without removing applicant names), the model can become even more bias.