The concern isn't that only whites will be smart enough.

The concern is that the current power structure will use this as a convenient way to bias the voter pool in its favor through strategic selection of questions.