I think there is also a racial component to it. We focus on features that enable us to distinguish people in our social circle. For example, for some groups of people hair color and eye color are not really distinguishing (a majority of the group have black hair and brown eyes). It would be interesting to see how many of the inaccurate identifications were cross-racial.