Attention to emotion modulates fMRI activity in human right superior temporal sulcus

A parallel neural network has been proposed for processing various types of information conveyed by faces including emotion. Using functional magnetic resonance imaging (fMRI), we tested the effect of the explicit attention to the emotional expression of the faces on the neuronal activity of the face-responsive regions. Delayed match to sample procedure was adopted. Subjects were required to match the visually presented pictures with regard to the contour of the face pictures, facial identity, and emotional expressions by valence (happy and fearful expressions) and arousal (fearful and sad expressions). Contour matching of the non-face scrambled pictures was used as a control condition. The face-responsive regions that responded more to faces than to non-face stimuli were the bilateral lateral fusiform gyrus (LFG), the right superior temporal sulcus (STS), and the bilateral intraparietal sulcus (IPS). In these regions, general attention to the face enhanced the activities of the bilateral LFG, the right STS, and the left IPS compared with attention to the contour of the facial image. Selective attention to facial emotion specifically enhanced the activity of the right STS compared with attention to the face per se. The results suggest that the right STS region plays a special role in facial emotion recognition within distributed face-processing systems. This finding may support the notion that the STS is involved in social perception.     

Neural response to emotional faces with and without awareness: event-related fMRI in a parietal patient with visual extinction and spatial neglect

This study examined whether differential neural responses are evoked by emotional stimuli with and without conscious perception, in a patient with visual neglect and extinction. Stimuli were briefly shown in either right, left, or both fields during event-related fMRI. On bilateral trials, either a fearful or neutral left face appeared with a right house, and it could either be extinguished from awareness or perceived. Seen faces in left visual field (LVF) activated primary visual cortex in the damaged right-hemisphere and bilateral fusiform gyri. Extinguished left faces increased activity in striate and extrastriate cortex, compared with right houses only. Critically, fearful faces activated the left amygdala and extrastriate cortex both when seen and when extinguished; as well as bilateral orbitofrontal and intact right superior parietal areas. Comparison of perceived versus extinguished faces revealed no difference in amygdala for fearful faces. Conscious perception increased activity in fusiform, parietal and prefrontal areas of the left-hemisphere, irrespective of emotional expression; while a differential emotional response to fearful faces occurring specifically with awareness was found in bilateral parietal, temporal, and frontal areas. These results demonstrate that amygdala and orbitofrontal cortex can be activated by emotional stimuli even without awareness after parietal damage; and that substantial unconscious residual processing can occur within spared brain areas well beyond visual cortex, despite neglect and extinction.     

Neural substrates of facial emotion processing using fMRI

We identified human brain regions involved in the perception of sad, frightened, happy, angry, and neutral facial expressions using functional magnetic resonance imaging (fMRI). Twenty-one healthy right-handed adult volunteers (11 men, 10 women; aged 18-45; mean age 21.6 years) participated in four separate runs, one for each of the four emotions. Participants viewed blocks of emotionally expressive faces alternating with blocks of neutral faces and scrambled images. In comparison with scrambled images, neutral faces activated the fusiform gyri, the right lateral occipital gyrus, the right superior temporal sulcus, the inferior frontal gyri, and the amygdala/entorhinal cortex. In comparisons of emotional and neutral faces, we found that (1) emotional faces elicit increased activation in a subset of cortical regions involved in neutral face processing and in areas not activated by neutral faces; (2) differences in activation as a function of emotion category were most evident in the frontal lobes; (3) men showed a differential neural response depending upon the emotion expressed but women did not.     

Affective blindsight in the intact brain: neural interhemispheric summation for unseen fearful expressions

The emotional valence of facial expressions can be reliably discriminated even in the absence of conscious visual experience by patients with lesions to the primary visual cortex (affective blindsight). Prior studies in one such patient (GY) also showed that this non-conscious perception can influence conscious recognition of normally seen emotional faces. Here we report a similar online interaction across hemispheres between conscious and non-conscious perception of emotions in normal observers. Fearful and happy facial expressions were presented either unilaterally (to the left or right visual field) or simultaneously to both visual fields. In bilateral displays, conscious perception of one face in a pair was prevented by backward masking after 20 ms, while the opposite expression remained normally visible. The results showed a bidirectional influence of non-conscious fear processing over conscious recognition of happy as well as fearful expressions. Consciously perceived fearful faces were more readily recognized when they were paired with invisible emotionally congruent fearful expressions in the opposite field, as compared to the single presentation of the same unmasked faces. On the other hand, recognition of unmasked happy faces was delayed by the simultaneous presence of a masked fearful face. No such effect was reported for masked happy expressions. These findings show that non-conscious processing of fear may modulate ongoing conscious evaluation of facial expressions via neural interhemispheric summation even in the intact brain.     

The neural substrates of affective processing toward positive and negative affective pictures in patients with major depressive disorder

Previous studies examining neural responses to emotional stimuli in individuals with major depressive disorder (MDD) have indicated increased responses within the left amygdala to sad faces, and increased activity within the visual cortex and striatum to expressions of happiness. Using functional magnetic resonance imaging (fMRI), the current study measured neural responses to neutral, positive and negative pictures of the International Affective Picture System in 15 healthy individuals and 15 patients with MDD. Depressed individuals demonstrated lower activity in the right hippocampus and the right insula to negative affective pictures, whereas they showed lower activity in the right anterior cingulate cortex and the left insula to positive pictures. However, within the MDD group, the severity of depression correlated with the activity of the left amygdala, bilateral inferior orbitofrontal areas, and the left insula to negative pictures, whereas there were no clear indications of association between specific cerebral regions and positive pictures. Our findings indicate that preferential decreases in the left amygdala in response to negative pictures might be involved in the processing of emotional stimuli in depressed individuals. Also, these findings suggest that the bilateral inferior orbitofrontal cortices and left amygdala may be preferentially recruited in MDD patients, but not in healthy individuals.     

Differential neural activity and connectivity for processing one's own face: A preliminary report

The experience of self is unique and pivotal to clinically relevant cognitive and emotional functions. However, well-controlled data on specialized brain regions and functional networks underlying the experience of self remain limited. This functional magnetic resonance imaging study investigated neural activity and connectivity specific to processing one's own face in healthy women by examining neural responses to the pictures of the subjects' own faces in contrast to faces of their own mothers, female friends and strangers during passive viewing, emotional and self-relevance evaluations. The processing of one's own face in comparison to processing of familiar faces revealed significant activity in right anterior insula (AI) and left inferior parietal lobule (IPL), and less activity in right posterior cingulate/precuneus (PCC/PCu) across all tasks. Further, the seed-based correlation analysis of right AI, and left IPL, showed differential functional networks in self and familiar faces contrasts. There were no differences in valence and saliency ratings between self and familiar others. Our preliminary results suggest that the self-experience cued by self-face is processed predominantly by brain regions and related networks that link interoceptive feelings and sense of body ownership to self-awareness and less by regions of higher order functioning such as autobiographical memories.     

Elevated noise power in gamma band related to negative symptoms and memory deficit in schizophrenia

Patients with schizophrenia have low extraversion and high neuroticism. These personality traits affect the everyday life of patients with schizophrenia, making it important to investigate neurobiological basis of personality traits. In healthy people, extraversion is associated with hemodynamic responses in the amygdala and electrophysiological brain activity such as event-related potential and event-related desynchronization during emotional face processing. Patients with schizophrenia show abnormal neural activity during emotional face processing, such as an N170 amplitude reduction. However, few studies to date have reported an association between personality traits and neural activity during emotional face processing in schizophrenia. In the present study, we examined N170 during emotional face processing, and association with personality traits in patients with schizophrenia. Fifteen male patients with chronic schizophrenia and 15 healthy male subjects participated in this study. Patients with schizophrenia had reduced N170 amplitudes (p=0.007). While healthy subjects had increased N170 amplitudes in response to emotional faces compared with neutral faces (p=0.003), patients with schizophrenia showed no difference in N170 amplitudes between emotional and neutral faces (p=0.60). Reduced N170 amplitude in response to neutral faces was correlated with low extraversion scores in patients with schizophrenia (r(s)=-0.69, p=0.005). The abnormal N170 and its association with extraversion in schizophrenia were found at the right rather than the left posterior temporal electrode. An abnormal N170 in schizophrenia may reflect impairments in the structural encoding of emotional faces, and indiscrimination between emotional and neutral faces at this stage of information processing. The association between abnormal N170 amplitudes and extraversion suggests that abnormal neural activity in the early stages of emotional face processing may underlie low extraversion characteristic of schizophrenia.     

Differential neural activity and connectivity for processing one's own face: a preliminary report

The experience of self is unique and pivotal to clinically relevant cognitive and emotional functions. However, well-controlled data on specialized brain regions and functional networks underlying the experience of self remain limited. This functional magnetic resonance imaging study investigated neural activity and connectivity specific to processing one's own face in healthy women by examining neural responses to the pictures of the subjects' own faces in contrast to faces of their own mothers, female friends and strangers during passive viewing, emotional and self-relevance evaluations. The processing of one's own face in comparison to processing of familiar faces revealed significant activity in right anterior insula (AI) and left inferior parietal lobule (IPL), and less activity in right posterior cingulate/precuneus (PCC/PCu) across all tasks. Further, the seed-based correlation analysis of right AI, and left IPL, showed differential functional networks in self and familiar faces contrasts. There were no differences in valence and saliency ratings between self and familiar others. Our preliminary results suggest that the self-experience cued by self-face is processed predominantly by brain regions and related networks that link interoceptive feelings and sense of body ownership to self-awareness and less by regions of higher order functioning such as autobiographical memories.     

Face perception is mediated by a distributed cortical network

The neural system associated with face perception in the human brain was investigated using functional magnetic resonance imaging (fMRI). In contrast to many studies that focused on discreet face-responsive regions, the objective of the current study was to demonstrate that regardless of stimulus format, emotional valence, or task demands, face perception evokes activation in a distributed cortical network. Subjects viewed various stimuli (line drawings of unfamiliar faces and photographs of unfamiliar, famous, and emotional faces) and their phase scrambled versions. A network of face-responsive regions was identified that included the inferior occipital gyrus, fusiform gyrus, superior temporal sulcus, hippocampus, amygdala, inferior frontal gyrus, and orbitofrontal cortex. Although bilateral activation was found in all regions, the response in the right hemisphere was stronger. This hemispheric asymmetry was manifested by larger and more significant clusters of activation and larger number of subjects who showed the effect. A region of interest analysis revealed that while all face stimuli evoked activation within all regions, viewing famous and emotional faces resulted in larger spatial extents of activation and higher amplitudes of the fMRI signal. These results indicate that a mere percept of a face is sufficient to localize activation within the distributed cortical network that mediates the visual analysis of facial identity and expression.     

Decoding of affective facial expressions in the context of emotional situations

The ability to recognize other persons' affective states and to link these with aspects of the current situation arises early in development and is precursor functions of a Theory of Mind (ToM). Until now, studies investigated either the processing of affective faces or affective pictures. In the present study, we tried to realize a scenario more similar to every day situations. We employed fMRI and used a picture matching task to explore the neural correlates associated with the integration and decoding of facial affective expressions in the context of affective situations. In the emotion condition, the participants judged an emotional facial expression with respect to the content of an emotional picture. In the two other conditions, participants indicated colour matches on the background of either affective or scrambled pictures. In contrast to colour matching on scrambled pictures, colour matching on emotional pictures resulted in longer reaction times and increased activation of the bilateral fusiform and occipital gyrus. These results indicated that, although task irrelevant, participants may attend to the emotional background of the pictures. The emotion task was associated with higher reaction times and with activation of the bilateral fusiform and occipital gyrus. Additionally, emotion attribution induced left amygdala activity. Possibly, attention processes and amygdala projections modulated the activation found in the occipital and fusiform areas. Furthermore, the involvement of the amygdala in the ToM precursor ability to link facial expressions with an emotional situation may indicate that the amygdala is involved in the development of stable ToM abilities.     

The emotional face of anorexia nervosa: The neural correlates of emotional processing

Social–emotional processing difficulties have been reported in Anorexia Nervosa (AN), yet the neural correlates remain unclear. Previous neuroimaging work is sparse and has not used functional connectivity paradigms to more fully explore the neural correlates of emotional difficulties. Fifty‐seven acutely unwell AN (AAN) women, 60 weight‐recovered AN (WR) women and 69 healthy control (HC) women categorised the gender of a series of emotional faces while undergoing Functional Magnetic Resonance Imaging. The mean age of the AAN group was 19.40 (2.83), WR 18.37 (3.59) and HC 19.37 (3.36). A whole brain and psychophysical interaction connectivity approach was used. Parameter estimates from significant clusters were extracted and correlated with clinical symptoms. Whilst no group level differences in whole brain activation were demonstrated, significant group level functional connectivity differences emerged. WR participants showed increased connectivity between the bilateral occipital face area and the cingulate, precentral gyri, superior, middle, medial and inferior frontal gyri compared to AAN and HC when viewing happy valenced faces. Eating disorder symptoms and parameter estimates were positively correlated. Our findings characterise the neural basis of social–emotional processing in a large sample of individuals with AN.     

Here's looking at you, kid: neural systems underlying face and gaze processing in fragile X syndrome

BACKGROUND: Children with fragile X syndrome (fraX) are at risk for manifesting abnormalities in social function that overlap with features of autism and social anxiety disorder. In this study, we analyzed brain activation in response to face and gaze stimuli to better understand neural functioning associated with social perception in fraX. METHODS: Eleven female subjects with fraX, aged 10 to 22 years, were compared with age-matched female control subjects. Photographs of forward-facing and angled faces, each having direct and averted gaze (4 types of stimuli), were presented in an event-related design during functional magnetic resonance imaging. Subjects were instructed to determine the direction of gaze for each photograph. Activation in brain regions known to respond to face and gaze stimuli, the fusiform gyrus (FG) and superior temporal sulcus (STS), were compared between groups to isolate neural abnormalities in the perception of directed social stimuli. RESULTS: The fraX subjects had decreased accuracy in determining the direction of gaze compared with controls. Region of interest analysis of the FG revealed a significant interaction between diagnostic group and face orientation. Specifically, control subjects had greater FG activation to forward than to angled faces, whereas fraX subjects had no difference in FG activation to forward and angled faces. Controls showed greater left STS activation to all stimuli compared with fraX subjects. CONCLUSIONS: Our results suggest that gaze aversion in fraX subjects is related to decreased specialization of the FG in the perception of face orientation. Decreased STS activation in fraX suggests aberrant processing of gaze. These data suggest that gaze aversion in fraX may be related to dysfunction of neural systems underlying both face and gaze processing.     

抑郁症患者情绪图片反应特征及杏仁核反应模式的研究

目的 探讨抑郁症患者对情感刺激的行为学反应模式及其相关的杏仁核时程反应过程.方法 12例首次发病、未经治疗的抑郁症患者(抑郁症组)和13名健康个体(健康对照组)对观看正性、中性和负性情绪图片的愉悦度等评分;并在被动注视任务下行功能磁共振成像,采用感兴趣区分析方法,比较两组杏仁核在不同情绪图片任务组块间的血氧水平依赖(BOLD)信号时间反应特征.结果 (1)抑郁症组情绪图片愉悦度评分[正性:(6.6 ±0.2)分;中性:(4.7 ±0.1)分]低于健康对照组[分别为(7.7 ±0.2)分和(5.1 ±0.1)分],负性情绪图片评分[(3.4 ±0.3)分]高于健康对照组[(2.2 ±0.2)分;P<0.01].(2)对正性情绪图片任务,两组间右侧杏仁核存在"组×时间"交互作用(P=0.002);抑郁症组杏仁核BOLD信号变化率为(0.02±0.09)%,激活时间后移至Block 2.对负性情绪图片任务,两组间左侧杏仁核有"组×时间"交互作用(P=0.008),右侧杏仁核存在组主效应(P=0.007)和时间主效应(P=0.016),抑郁症组BOLD信号变化率低于(-0.06 ±0.14)%.结论 杏仁核是抑郁症患者丧失愉悦体验和情绪低落的神经基础之一.     

Manifold decoding for neural representations of face viewpoint and gaze direction using magnetoencephalographic data

The main challenge in decoding neural representations lies in linking neural activity to representational content or abstract concepts. The transformation from a neural‐based to a low‐dimensional representation may hold the key to encoding perceptual processes in the human brain. In this study, we developed a novel model by which to represent two changeable features of faces: face viewpoint and gaze direction. These features are embedded in spatiotemporal brain activity derived from magnetoencephalographic data. Our decoding results demonstrate that face viewpoint and gaze direction can be represented by manifold structures constructed from brain responses in the bilateral occipital face area and right superior temporal sulcus, respectively. Our results also show that the superposition of brain activity in the manifold space reveals the viewpoints of faces as well as directions of gazes as perceived by the subject. The proposed manifold representation model provides a novel opportunity to gain further insight into the processing of information in the human brain.     

Age-related differences in brain regions supporting successful encoding of emotional faces

In an event-related functional Magnetic Resonance Imaging (fMRI) study, younger and older adults were presented with negative emotional (i.e., fearful) and neutral face pictures under incidental learning conditions. They were subsequently given a test of face recognition outside the scanner. Both age groups activated amygdala bilaterally as well as the right hippocampus during successful encoding of the fearful faces. Direct age comparisons revealed greater activation in right amygdala and bilateral hippocampus in the young, whereas older adults showed greater activation in the left insular and right prefrontal cortices. None of these brain areas was activated during successful encoding of neutral faces, suggesting specificity of these brain activation patterns. The results indicate an age-related shift in the neural underpinnings of negative emotional face processing from medial-temporal to neocortical regions.     

Age-related differences in the medial temporal lobe responses to emotional faces as revealed by fMRI

Age-related differences involved in the neural substrates of emotional face perception were investigated in young and old healthy volunteers. The subjects were scanned using functional magnetic resonance imaging while they were judging the gender of faces with negative, positive, or neutral emotional valence. The results showed that both the predominant activation in young subjects and reduced activity in old subjects contributed to a significant age difference in the left amygdala during the perception of negative faces. Activity in the right parahippocampal gyrus during the perception of positive faces diminished with advancing age. Neural activity in the angular gyrus and lingual gyrus of the right hemisphere was reduced in the old subjects during the perception of positive faces. There was no region where old subjects had greater activity than young subjects during the task. In old subjects, the overall activity in the right hippocampus during the task correlated negatively with age, whereas the activity in the right parahippocampal gyrus correlated positively with neuropsychological performance. There was no significant correlation between subjects' characteristics and signal change in young subjects. These results indicate the age-associated vulnerability of the medial temporal lobe structures including the amygdala, hippocampus, and parahippocampal gyrus during face perception. The dissociation with reduced activity in the left amygdala and the right parahippocampal gyrus may suggest that aging differentially affects neural responses to faces with negative or positive emotional valence. The parieto-occipital lobe, which has been found to be involved in face processing, also showed a functional decline associated with aging.     

The interaction of social and emotional processes in the brain

Social stimuli function as emotional barometers for the immediate environment are the catalysts for many emotional reactions, and have inherent value for relationships and survival independent of their current emotional content. We, therefore, propose that the neural mechanisms underlying social and emotional information processing may be interconnected. In the current study, we examined the independent and interactive effects of social and emotional processes on brain activation. Whole-brain images were acquired while participants viewed and categorized affective pictures that varied on two dimensions: emotional content (i. e., neutral, emotional) and social content (i. e., faces/people, objects/scenes). Patterns of activation were consistent with past findings demonstrating that the amygdala and part of the visual cortex were more active to emotionally evocative pictures than to neutral pictures and that the superior temporal sulcus was more active to social than to nonsocial pictures. Furthermore, activation of the superior temporal sulcus and middle occipito-temporal cortex showed evidence of the interactive processing of emotional and social information, whereas activation of the amygdala showed evidence of additive effects. These results indicate that interactive effects occur early in the stream of processing, suggesting that social and emotional information garner greater attentional resources and that the conjunction of social and emotional cues results in synergistic early processing, whereas the amygdala appears to be primarily implicated in processing biologically or personally relevant stimuli, regardless of the nature of the relevance (i. e., social, emotional, or both).     

Autistic traits modulate conscious and nonconscious face perception

Difficulty with emotion perception is a core feature of autism spectrum disorder (ASD) that is also associated with the broader autism phenotype. The current study explored the neural underpinnings of conscious and nonconscious perceptions of affect in typically developing individuals with varying levels of autistic-like traits, as measured by the Autism Quotient (AQ). We investigated the relationship between autistic traits and face processing efficiency using event-related potentials (ERPs). In 20 typically developing adults, we utilized ERPs (the P100, N170, and P300) to measure differences in face processing for emotional faces that were presented either (a) too quickly to reach conscious awareness (16 ms) or (b) slowly enough to be consciously observed (200 ms). All individuals evidenced increased P100 and P300 amplitude and shorter N170 latencies for nonconscious versus consciously presented faces. Individuals with high AQ scores evidenced delayed ERP components. Nonconsciously perceived emotional faces elicited enhanced neural responses regardless of AQ score. Higher levels of autistic traits were associated with inefficient face perception (i.e., longer latency of ERP components). This delay parallels processing delays observed in ASD. These data suggest that inefficient social perception is present in individuals with subclinical levels of social impairment.     

Extracting variant and invariant information from faces: the neural substrates of gaze detection and sex categorization

Guided by influential models of face processing, efforts have been expended to uncover the neural substrates subserving the many facets of face perception. Extending this work, the present study used functional brain imaging (fMRI) to explore the relationship between the operations supporting the explicit extraction of sex and gaze-related information from faces. The brain imaging data showed the right superior temporal sulcus to be preferentially involved during assessments of gaze direction and a region of the left fusiform gyrus to be involved during sex categorization. These results provide support for the distributed face-processing model advanced by Haxby and colleagues (2000).     

Altered fusiform connectivity during processing of fearful faces in social anxiety disorder

Social anxiety disorder (SAD) has been associated with hyper-reactivity in limbic brain regions like the amygdala, both during symptom provocation and emotional face processing tasks. In this functional magnetic resonance imaging study we sought to examine brain regions implicated in emotional face processing, and the connectivity between them, in patients with SAD (n=14) compared with healthy controls (n=12). We furthermore aimed to relate brain reactivity and connectivity to self-reported social anxiety symptom severity. SAD patients exhibited hyper-reactivity in the bilateral fusiform gyrus in response to fearful faces, as well as greater connectivity between the fusiform gyrus and amygdala, and decreased connectivity between the fusiform gyrus and ventromedial prefrontal cortex. Within the SAD group, social anxiety severity correlated positively with amygdala reactivity to emotional faces, amygdala-fusiform connectivity and connectivity between the amygdala and superior temporal sulcus (STS). These findings point to a pivotal role for the fusiform gyrus in SAD neuropathology, and further suggest that altered amygdala-fusiform and amygdala-STS connectivity could underlie previous findings of aberrant socio-emotional information processing in this anxiety disorder.