Face Processing in Children with Autism Spectrum Disorder: Independent or Interactive Processing of Facial Identity and Facial Expression?

The current study investigated if deficits in processing emotional expression affect facial identity processing and vice versa in children with autism spectrum disorder. Children with autism and IQ and age matched typically developing children classified faces either by emotional expression, thereby ignoring facial identity or by facial identity disregarding emotional expression. Typically developing children processed facial identity independently from facial expressions but processed facial expressions in interaction with identity. Children with autism processed both facial expression and identity independently of each other. They selectively directed their attention to one facial parameter despite variations in the other. Results indicate that there is no interaction in processing facial identity and emotional expression in autism spectrum disorder.     

Facial emotion recognition in schizophrenia: when and why does it go awry?

OBJECTIVE: Schizophrenia patients demonstrate impaired emotional processing that may be due, in part, to impaired facial emotion recognition. This study examined event-related potential (ERP) responses to emotional faces in schizophrenia patients and controls to determine when, in the temporal processing stream, patient abnormalities occur. METHOD: 16 patients and 16 healthy control participants performed a facial emotion recognition task. Very sad, somewhat sad, neutral, somewhat happy, and very happy faces were each presented for 100 ms. Subjects indicated whether each face was "Happy", "Neutral", or "Sad". Evoked potential data were obtained using a 32-channel EEG system. RESULTS: Controls performed better than patients in recognizing facial emotions. In patients, better recognition of happy faces correlated with less severe negative symptoms. Four ERP components corresponding to the P100, N170, N250, and P300 were identified. Group differences were noted for the N170 "face processing" component that underlies the structural encoding of facial features, but not for the subsequent N250 "affect modulation" component. Higher amplitude of the N170 response to sad faces was correlated with less severe delusional symptoms. Although P300 abnormalities were found, the variance of this component was explained by the earlier N170 response. CONCLUSION: Patients with schizophrenia demonstrate abnormalities in early visual encoding of facial features that precedes the ERP response typically associated with facial affect recognition. This suggests that affect recognition deficits, at least for happy and sad discrimination, are secondary to faulty structural encoding of faces. The association of abnormal face encoding with delusions may denote the physiological basis for clinical misidentification syndromes.     

Facial emotion recognition in Parkinson’s disease: Association with age and olfaction

Objective: The ability to recognize facial emotion expressions has been reported to be impaired in Parkinson’s disease (PD), yet previous studies showed inconsistent findings. The aim of this study was to further investigate facial emotion recognition (FER) in PD patients and its association with demographic and clinical parameters (including motor and nonmotor symptoms). Method: Thirty-four nondemented PD patients and 24 age- and sex-matched healthy controls (HC) underwent clinical neurological and neuropsychological assessment, standardized olfactory testing with Sniffin’ Sticks, and the Ekman 60 Faces Emotion Recognition Test. Results: PD patients had a significantly lower score on the total FER task than HC (p = .006), even after controlling for the potential confounding factors depression and apathy. The PD group had a specific impairment in the recognition of surprise (p = .007). The recognition of anger approached statistical significance (p = .07). Increasing chronological age and age at disease onset were associated with worse performance on the FER task in PD patients. Olfactory function along with PD diagnosis predicted worse FER performance within all study participants. Conclusion: Facial emotion recognition and especially the recognition of surprise are significantly impaired in PD patients compared with age- and sex-matched HC. The association of FER with age and olfactory function is endorsed by common structures that undergo neurodegeneration in PD. The relevance of FER in social interaction stresses the clinical relevance and the need for further investigation in this field. Future studies should also determine whether impaired FER is already present in premotor stages of PD.     

Facial expression recognition: can preschoolers with cochlear implants and hearing aids catch it?

Tager-Flusberg and Sullivan (2000) presented a cognitive model of theory of mind (ToM), in which they thought ToM included two components--a social-perceptual component and a social-cognitive component. Facial expression recognition (FER) is an ability tapping the social-perceptual component. Previous findings suggested that normal hearing children did not demonstrate any advantage over those with cochlear implants (CI) or hearing aids (HA) in FER with age and gender matched. In these studies, the ages of the participants with CI or HA were over 7 years old. However, normal hearing preschoolers can accurately recognize basic facial expressions. Children's early FER skills are essential to later successful social interactions. It is not clear whether preschoolers with CI or HA have problems in FER. Two experiments were conducted to compare the FER of preschoolers with CI or HA with normal hearing children (with age matched). The results of both experiments consistently showed that normal hearing children performed significantly better than those with CI or HA, suggesting to some extent that there was a delay in preschoolers with CI or HA on FER. No significant correlations (with age and type of participants controlled) were found between language ability (measured by PPVT) and FER in Experiment 2, to some extent validating a cognitive model of ToM in another view. The findings suggested that earlier rehabilitation for children with CI or HA should include not only language treatment but also emotional intervention, which would help them catch up with normal hearings as soon as possible.     

Reaction Time of Facial Affect Recognition in Asperger’s Disorder for Cartoon and Real,Static and Moving Faces

This study used a choice reaction-time paradigm to test the perceived impairment of facial affect recognition in Asperger’s disorder. Twenty teenagers with Asperger’s disorder and 20 controls were compared with respect to the latency and accuracy of response to happy or disgusted facial expressions, presented in cartoon or real images and in static or moving conditions. Group analysis revealed that the Asperger group did not differ significantly from the control group in speed and accuracy for both affects and in all presentation modalities. Individual analysis, however, revealed that the proportion of participants exhibiting a happy face advantage was smaller in the Asperger group than in the control group. The results did not support the notion of impairment in facial affect recognition in terms of speed and accuracy in Asperger’s disorder. Findings also revealed that the absence of happy face advantage was more prevalent in individuals with Asperger’s disorder.     

Decoding of Emotion through Facial Expression, Prosody and Verbal Content in Children and Adolescents with Asperger’s Syndrome

This study examined differences in the ability to decode emotion through facial expression, prosody, and verbal content between 14 children with Asperger’s Syndrome (AS) and 16 typically developing peers. The ability to decode emotion was measured by the Perception of Emotion Test (POET), which portrayed the emotions of happy, angry, sad, and neutral among the modalities of static and dynamic facial expression, prosody, verbal content, and all modalities combined. Results revealed that children with AS had more difficulty identifying emotions through static facial expression, dynamic facial expression, and prosody than typically developing children. Results are discussed in relationship to an over-reliance on verbal content as a compensatory strategy in social interactions. Treatment implications for individuals with AS are also discussed.     

Global–Local Precedence in the Perception of Facial Age and Emotional Expression by Children with Autism and Other Developmental Disabilities

Global information processing and perception of facial age and emotional expression was studied in children with autism, language disorders, mental retardation, and a clinical control group. Children were given a global–local task and asked to recognize age and emotion in human and canine faces. Children with autism made fewer global responses and more errors when recognizing human and canine emotions and canine age than children without autism. Significant relationships were found between global information processing and the recognition of human and canine emotions and canine age. Results are discussed with respect to the relationship between global information processing and face perception and neural structures underlying these abilities.     

Symptom Correlates of Static and Dynamic Facial Affect Processing in Schizophrenia: Evidence of a Double Dissociation?

Schizophrenia patients have been shown to be compromised in their ability to recognize facial emotion. This deficit has been shown to be related to negative symptoms severity. However, to date, most studies have used static rather than dynamic depictions of faces. Nineteen patients with schizophrenia were compared with seventeen controls on 2 tasks; the first involving the discrimination of facial identity, emotion, and butterfly wings; the second testing emotion recognition using both static and dynamic stimuli. In the first task, the patients performed more poorly than controls for emotion discrimination only, confirming a specific deficit in facial emotion recognition. In the second task, patients performed more poorly in both static and dynamic facial emotion processing. An interesting pattern of associations suggestive of a possible double dissociation emerged in relation to correlations with symptom ratings: high negative symptom ratings were associated with poorer recognition of static displays of emotion, whereas high positive symptom ratings were associated with poorer recognition of dynamic displays of emotion. However, while the strength of associations between negative symptom ratings and accuracy during static and dynamic facial emotion processing was significantly different, those between positive symptom ratings and task performance were not. The results confirm a facial emotion-processing deficit in schizophrenia using more ecologically valid dynamic expressions of emotion. The pattern of findings may reflect differential patterns of cortical dysfunction associated with negative and positive symptoms of schizophrenia in the context of differential neural mechanisms for the processing of static and dynamic displays of facial emotion.     

Facial and skeletal malformations, mental retardation, aganglionosis, and neurogenic muscle weakness: a variant of Niikawa-Kuroki syndrome or a new syndrome?

We report a 10-year-old boy with multiple congenital anomalies/mental retardation syndrome, who also presented with aganglionosis and neurogenic muscle weakness. Some phenotypic manifestations of our patient overlap with those observed in the Niikawa-Kuroki syndrome; however, the hypothesis of a new distinct entity, with simultaneous involvement of the central and peripheral nervous system, is considered.     

Facial emotion perception in schizophrenia: Does sex matter?

AIM: To review the literature on sex differences in facial emotion perception (FEP) across the schizophrenia spectrum. METHODS: We conducted a systematic review of empirical articles that were included in five separate meta-analyses of FEP across the schizophrenia spectrum, including meta-analyses that predominantly examined adults with chronic schizophrenia, people with early (onset prior to age 18) or recent-onset (experiencing their first or second psychotic episode or illness duration less than 2 years) schizophrenia, and unaffected first-degree relatives of people with schizophrenia. We also examined articles written in English (from November 2011 through June 2015) that were not included in the aforementioned meta-analyses through a literature search in the PubMed database. All relevant articles were accessed in full text. We examined all studies to determine the sample sizes, diagnostic characteristics, demographic information, methodologies, results, and whether each individual study reported on sex differences. The results from the meta-analyses themselves as well as the individual studies are reported in tables and text. RESULTS: We retrieved 134 articles included in five separate meta-analyses and the PubMed database that examined FEP across the schizophrenia spectrum. Of these articles, 38 examined sex differences in FEP. Thirty of these studies did not find sex differences in FEP in either chronically ill adults with schizophrenia, early-onset or recently diagnosed people with schizophrenia, or first-degree relatives of people with schizophrenia. Of the eight studies that found sex differences in FEP, three found that chronically ill women outperformed men, one study found that girls with early-onset schizophrenia outperformed boys, and two studies found that women (including first-degree relatives, adults with schizophrenia, and the healthy control group) outperformed men on FEP tasks. In total, six of the eight studies that examined sex differences in FEP found that women outperformed men across the schizophrenia spectrum. CONCLUSION: Evidence to date suggests few sex differences in FEP in schizophrenia; both men and women across the schizophrenia spectrum have deficits in FEP.     

“Who Said That?” Matching of Low- and High-Intensity Emotional Prosody to Facial Expressions by Adolescents with ASD

Data on emotion processing by individuals with ASD suggest both intact abilities and significant deficits. Signal intensity may be a contributing factor to this discrepancy. We presented low- and high-intensity emotional stimuli in a face-voice matching task to 22 adolescents with ASD and 22 typically developing (TD) peers. Participants heard semantically neutral sentences with happy, surprised, angry, and sad prosody presented at two intensity levels (low, high) and matched them to emotional faces. The facial expression choice was either across- or within-valence. Both groups were less accurate for low-intensity emotions, but the ASD participants’ accuracy levels dropped off more sharply. ASD participants were significantly less accurate than their TD peers for trials involving low-intensity emotions and within-valence face contrasts.     

How Do Schizophrenia Patients Use Visual Information to Decode Facial Emotion?

Impairment in recognizing facial emotions is a prominent feature of schizophrenia patients, but the underlying mechanism of this impairment remains unclear. This study investigated the specific aspects of visual information that are critical for schizophrenia patients to recognize emotional expression. Using the Bubbles technique, we probed the use of visual information during a facial emotion discrimination task (fear vs. happy) in 21 schizophrenia patients and 17 healthy controls. Visual information was sampled through randomly located Gaussian apertures (or “bubbles”) at 5 spatial frequency scales. Online calibration of the amount of face exposed through bubbles was used to ensure 75% overall accuracy for each subject. Least-square multiple linear regression analyses between sampled information and accuracy were performed to identify critical visual information that was used to identify emotional expression. To accurately identify emotional expression, schizophrenia patients required more exposure of facial areas (i.e., more bubbles) compared with healthy controls. To identify fearful faces, schizophrenia patients relied less on bilateral eye regions at high-spatial frequency compared with healthy controls. For identification of happy faces, schizophrenia patients relied on the mouth and eye regions; healthy controls did not utilize eyes and used the mouth much less than patients did. Schizophrenia patients needed more facial information to recognize emotional expression of faces. In addition, patients differed from controls in their use of high-spatial frequency information from eye regions to identify fearful faces. This study provides direct evidence that schizophrenia patients employ an atypical strategy of using visual information to recognize emotional faces.     

How do Typically Developing Deaf Children and Deaf Children with Autism Spectrum Disorder Use the Face When Comprehending Emotional Facial Expressions in British Sign Language?

Facial expressions in sign language carry a variety of communicative features. While emotion can modulate a spoken utterance through changes in intonation, duration and intensity, in sign language specific facial expressions presented concurrently with a manual sign perform this function. When deaf adult signers cannot see facial features, their ability to judge emotion in a signed utterance is impaired (Reilly et al. in Sign Lang Stud 75:113–118, 1992). We examined the role of the face in the comprehension of emotion in sign language in a group of typically developing (TD) deaf children and in a group of deaf children with autism spectrum disorder (ASD). We replicated Reilly et al.’s (Sign Lang Stud 75:113–118, 1992) adult results in the TD deaf signing children, confirming the importance of the face in understanding emotion in sign language. The ASD group performed more poorly on the emotion recognition task than the TD children. The deaf children with ASD showed a deficit in emotion recognition during sign language processing analogous to the deficit in vocal emotion recognition that has been observed in hearing children with ASD.     

Misperceptions of Facial Emotions Among Youth Aged 9–14 Years Who Present Multiple Antecedents of Schizophrenia

Similar to adults with schizophrenia, youth at high risk for developing schizophrenia present difficulties in recognizing emotions in faces. These difficulties might index vulnerability for schizophrenia and play a role in the development of the illness. Facial emotion recognition (FER) impairments have been implicated in declining social functioning during the prodromal phase of illness and are thus a potential target for early intervention efforts. This study examined 9- to 14-year-old children: 34 children who presented a triad of well-replicated antecedents of schizophrenia (ASz), including motor and/or speech delays, clinically relevant internalizing and/or externalizing problems, and psychotic-like experiences (PLEs), and 34 typically developing (TD) children who presented none of these antecedents. An established FER task (ER40) was used to assess correct recognition of happy, sad, angry, fearful, and neutral expressions, and facial emotion misperception responses were made for each emotion type. Relative to TD children, ASz children presented an overall impairment in FER. Further, ASz children misattributed neutral expressions to face displaying other emotions and also more often mislabeled a neutral expression as sad compared with healthy peers. The inability to accurately discriminate subtle differences in facial emotion and the misinterpretation of neutral expressions as sad may contribute to the initiation and/or persistence of PLEs. Interventions that are effective in teaching adults to recognize emotions in faces could potentially benefit children presenting with antecedents of schizophrenia.Key words: emotion recognition, high risk, child and adolescent psychopathology, social functioning, psychotic-like experiencesPeople with schizophrenia display a marked impairment in recognizing emotions in the faces of others, particularly anger, sadness, and fear, and less difficulty recognizing happy expressions.^1,2 Facial emotion recognition (FER) difficulties are associated with poor social functioning³ and have implications for the development, course, and outcome of the disorder.⁴ Yet, interventions to improve FER performance (eg, Training of Affect Recognition)⁵ can reduce these deficits and elicit generalized improvement in other social cognitive domains.⁶FER impairments are apparent not only among individuals with chronic schizophrenia (for review see Kohler et al 2010)² but also among individuals experiencing a first episode of psychosis^7,8 and among unaffected adolescent (though only for neutral facial expressions)⁹ and adult first-degree relatives of individuals with schizophrenia.¹⁰ Thus, abnormalities in FER are present at illness onset and may also index vulnerabil ity for schizophrenia. Prospective studies following individuals at elevated risk for developing schizophrenia are needed to determine the extent to which impairments of FER precede illness and represent potential targets for early intervention. Among symptomatic, help-seeking individuals meeting ultra-high risk (UHR) criteria for psychosis,^7,8,11–13 evidence for FER impairments is mixed. Two studies reported FER impairments relative to healthy participants,^7,11 while another study indicated specific difficulties in correctly identifying neutral expressions.¹³ A study of a large British birth cohort comprising 5267 children reported no association between FER at 8 years and subclinical psychotic symptoms at 12 years.¹⁴ By contrast, a recent cross-sectional study of 748 children aged 10–13 years indicated that those reporting psychotic-like experiences (PLEs) on questionnaires were poorer at recognizing facial emotional expressions, primarily sadness.¹⁵ Unfortunately, as with many previous FER studies, no information was provided about the nature of the facial emotion misperceptions committed when processing facial expressions. Though PLEs in childhood are significantly associated with later psychotic illness,^16,17 they are also associated with an increased risk of anxiety disorders¹⁶ and other psychiatric disorders including affective disorders, drug use disorders, and personality disorders,¹⁸ albeit to a lesser extent. Thus, PLEs constitute a relatively nonspecific marker of risk for subsequent psychiatric disorders. Further, cross-sectional data from the general population indicate significant comorbidity of PLEs with emotional and behavioral problems,^19,20 implying that the observed relationship between PLEs and FER reported by Roddy et al¹⁵ might reflect the presence of unreported internalizing and/or externalizing psychopathology.To better characterize the nature of FER associated with schizophrenia, several studies have examined facial emotion misperceptions. Relative to healthy adults, individuals with schizophrenia more often mislabel negative emotions to faces displaying no or neutral expressions.^21,22 Adolescent relatives of individuals with schizophrenia, compared with adolescents from healthy families, also more often incorrectly label neutral expressions as displaying negative emotions, predominantly mislabeling them as sad.⁹ Among individuals with schizophrenia, and individuals at high risk for psychosis,²³ functional imaging has revealed hyperactivation of the amygdala during the processing of neutral expressions, which could reflect emotional salience being assigned to neutral stimuli.²⁴ It has been suggested that the tendency to misinterpret neutral facial expressions as displaying emotion may contribute to the development of positive symptoms in schizophrenia.²³ Previous research indicates that facial emotion misperceptions might constitute the cognitive mechanism contributing to the social impairment that characterizes UHR samples¹³ and is a critical component to understanding FER difficulties in samples at risk for schizophrenia.Until recently, there has been no practical method for identifying children who are at elevated risk for schizophrenia. Despite the high heritability of schizophrenia, only approximately one-third of individuals with schizophrenia have a first- or second-degree relative with the illness. Consequently, a positive family history identifies only a subset of children who will develop the illness.²⁵ Prospective investigations of birth cohorts have demonstrated consistently that, by middle childhood, individuals who later developed schizophrenia presented delays in motor and language development; disturbances in social, emotional, and behavioral functioning; and PLEs.¹⁷ Based on this evidence, we developed questionnaires, to be completed by children aged 9–12 years and their primary caregiver, to identify children who present a triad of these replicated antecedents of schizophrenia (ASz).^26,27 We defined ASz to include (1) early speech and/or motor developmental delays/abnormalities; (2) social, emotional, and/or behavioral problems in the clinical range; and (3) PLEs. It is thought that the identification of children who present multiple antecedents of schizophrenia that have been replicated in prospective longitudinal studies will offer greater sensitivity and specificity for later development of schizophrenia than any one antecedent.We are currently following the development of ASz children to determine the specificity and sensitivity of the triad of antecedents for later schizophrenia development. We anticipate that some ASz children will develop schizophrenia and spectrum disorders, some will develop other disorders, and others will remain healthy. In the interim, our investigations have shown that ASz children, compared with typically developing (TD) children who present no antecedents and no family history of schizophrenia or a spectrum disorder, are characterized by features observed among adults with schizophrenia including (1) deficits in performance on standardized intelligence and neuropsychological tests of executive function and memory,²⁸ (2) dyskinetic movement abnormalities,²⁹ (3) reduction in the amplitude of the error-related negativity event-related potential component generated in the anterior cingulate that indexes internal monitoring of behavior,³⁰ and (4) structural brain abnormalities in the superior/middle temporal gyri.³¹ Further, among children aged 9–12 years, two-thirds (69%) of those presenting with the triad of antecedents report distress and/or functional impairment associated with their PLEs.²⁷This study sought to determine whether ASz children present FER difficulties similar to those reported among individuals with schizophrenia and at-risk youth, after accounting for intelligence quotient (IQ) differences between ASz and TD groups,²⁸ which may contribute to FER performance. The study examined overall performance on FER tasks, as well as the specific nature of facial emotion misperceptions. We hypothesized that ASz children would be less accurate than TD children in identifying emotions in facial expressions and that they would more often mislabel neutral faces with other emotion expressions. In particular, we anticipated that ASz children would misidentify neutral expressions as sad, as was reported in a study of youth with family histories of schizophrenia using the same FER task.⁹