That's a fascinating question - I'm aphantasic and mildly face blind (I thought the two female leads in Disclosure Day were the same person for most of the movie and that we were jumping back and forth in her timeline). I've always assumed I'm face blind because of the aphantasia, but I know several aphantasics who have no problem recognising faces.

In answer to the question though, no - even as someone with face blindness, the faces of people I've known and loved for a long time are burned in somewhere - I just can't access that part of my brain at will.