For the first couple of months of my most recent relationship I would meet my partner at the train station. I was always worried that I wouldn't recognize her in the crowd and she would somehow know. I also can't recall a person's name moments after I hear it. But I can do many other mental gymnastics that surprise my friends and family.
Thinking about it further it only affects one lookup direction. Name -> Face is incredibly difficult for me, but Face -> Name is a lot easier (and really the reason I didn't need to worry as much as I did).
