Neural response to emotional faces with and without awareness: event-related fMRI in a parietal patient with visual extinction and spatial neglect

This study examined whether differential neural responses are evoked by emotional stimuli with and without conscious perception, in a patient with visual neglect and extinction. Stimuli were briefly shown in either right, left, or both fields during event-related fMRI. On bilateral trials, either a fearful or neutral left face appeared with a right house, and it could either be extinguished from awareness or perceived. Seen faces in left visual field (LVF) activated primary visual cortex in the damaged right-hemisphere and bilateral fusiform gyri. Extinguished left faces increased activity in striate and extrastriate cortex, compared with right houses only. Critically, fearful faces activated the left amygdala and extrastriate cortex both when seen and when extinguished; as well as bilateral orbitofrontal and intact right superior parietal areas. Comparison of perceived versus extinguished faces revealed no difference in amygdala for fearful faces. Conscious perception increased activity in fusiform, parietal and prefrontal areas of the left-hemisphere, irrespective of emotional expression; while a differential emotional response to fearful faces occurring specifically with awareness was found in bilateral parietal, temporal, and frontal areas. These results demonstrate that amygdala and orbitofrontal cortex can be activated by emotional stimuli even without awareness after parietal damage; and that substantial unconscious residual processing can occur within spared brain areas well beyond visual cortex, despite neglect and extinction.     

Distributed and interactive brain mechanisms during emotion face perception: evidence from functional neuroimaging

Brain imaging studies in humans have shown that face processing in several areas is modulated by the affective significance of faces, particularly with fearful expressions, but also with other social signals such gaze direction. Here we review haemodynamic and electrical neuroimaging results indicating that activity in the face-selective fusiform cortex may be enhanced by emotional (fearful) expressions, without explicit voluntary control, and presumably through direct feedback connections from the amygdala. fMRI studies show that these increased responses in fusiform cortex to fearful faces are abolished by amygdala damage in the ipsilateral hemisphere, despite preserved effects of voluntary attention on fusiform; whereas emotional increases can still arise despite deficits in attention or awareness following parietal damage, and appear relatively unaffected by pharmacological increases in cholinergic stimulation. Fear-related modulations of face processing driven by amygdala signals may implicate not only fusiform cortex, but also earlier visual areas in occipital cortex (e.g., V1) and other distant regions involved in social, cognitive, or somatic responses (e.g., superior temporal sulcus, cingulate, or parietal areas). In the temporal domain, evoked-potentials show a widespread time-course of emotional face perception, with some increases in the amplitude of responses recorded over both occipital and frontal regions for fearful relative to neutral faces (as well as in the amygdala and orbitofrontal cortex, when using intracranial recordings), but with different latencies post-stimulus onset. Early emotional responses may arise around 120ms, prior to a full visual categorization stage indexed by the face-selective N170 component, possibly reflecting rapid emotion processing based on crude visual cues in faces. Other electrical components arise at later latencies and involve more sustained activities, probably generated in associative or supramodal brain areas, and resulting in part from the modulatory signals received from amygdala. Altogether, these fMRI and ERP results demonstrate that emotion face perception is a complex process that cannot be related to a single neural event taking place in a single brain regions, but rather implicates an interactive network with distributed activity in time and space. Moreover, although traditional models in cognitive neuropsychology have often considered that facial expression and facial identity are processed along two separate pathways, evidence from fMRI and ERPs suggests instead that emotional processing can strongly affect brain systems responsible for face recognition and memory. The functional implications of these interactions remain to be fully explored, but might play an important role in the normal development of face processing skills and in some neuropsychiatric disorders.     

Modular Network between Postrhinal Visual Cortex,Amygdala, and Entorhinal Cortex

The postrhinal area (POR) is a known center for integrating spatial with nonspatial visual information and a possible hub for influencing landmark navigation by affective input from the amygdala. This may involve specific circuits within muscarinic acetylcholine receptor 2 (M2)-positive (M2⁺) or M2^– modules of POR that associate inputs from the thalamus, cortex, and amygdala, and send outputs to the entorhinal cortex. Using anterograde and retrograde labeling with conventional and viral tracers in male and female mice, we found that all higher visual areas of the ventral cortical stream project to the amygdala, while such inputs are absent from primary visual cortex and dorsal stream areas. Unexpectedly for the presumed salt-and-pepper organization of mouse extrastriate cortex, tracing results show that inputs from the dorsal lateral geniculate nucleus and lateral posterior nucleus were spatially clustered in layer 1 (L1) and overlapped with M2⁺ patches of POR. In contrast, input from the amygdala to L1 of POR terminated in M2^– interpatches. Importantly, the amygdalocortical input to M2^– interpatches in L1 overlapped preferentially with spatially clustered apical dendrites of POR neurons projecting to amygdala and entorhinal area lateral, medial (ENTm). The results suggest that subnetworks in POR, used to build spatial maps for navigation, do not receive direct thalamocortical M2⁺ patch-targeting inputs. Instead, they involve local networks of M2^– interpatches, which are influenced by affective information from the amygdala and project to ENTm, whose cells respond to visual landmark cues for navigation.SIGNIFICANCE STATEMENT A central purpose of visual object recognition is identifying the salience of objects and approaching or avoiding them. However, it is not currently known how the visual cortex integrates the multiple streams of information, including affective and navigational cues, which are required to accomplish this task. We find that in a higher visual area, the postrhinal cortex, the cortical sheet is divided into interdigitating modules receiving distinct inputs from visual and emotion-related sources. One of these modules is preferentially connected with the amygdala and provides outputs to entorhinal cortex, constituting a processing stream that may assign emotional salience to objects and landmarks for the guidance of goal-directed navigation.     

Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness

The attractiveness of a face is a highly salient social signal, influencing mate choice and other social judgements. In this study, we used event-related functional magnetic resonance imaging (fMRI) to investigate brain regions that respond to attractive faces which manifested either a neutral or mildly happy face expression. Attractive faces produced activation of medial orbitofrontal cortex (OFC), a region involved in representing stimulus-reward value. Responses in this region were further enhanced by a smiling facial expression, suggesting that the reward value of an attractive face as indexed by medial OFC activity is modulated by a perceiver directed smile.     

Effective connectivity between amygdala and orbitofrontal cortex differentiates the perception of facial expressions

Abstract

Emotion research is guided both by the view that emotions are points in a dimensional space, such as valence or approach–withdrawal, and by the view that emotions are discrete categories. We determined whether effective connectivity of amygdala with medial orbitofrontal cortex (MOFC) and lateral orbitofrontal cortex (LOFC) differentiates the perception of emotion faces in a manner consistent with the dimensional and/or categorical view. Greater effective connectivity from left MOFC to amygdala differentiated positive and neutral expressions from negatively valenced angry, disgust, and fear expressions. Greater effective connectivity from right LOFC to amygdala differentiated emotion expressions conducive to perceiver approach (happy, neutral, and fear) from angry expressions that elicit perceiver withdrawal. Finally, consistent with the categorical view, there were unique patterns of connectivity in response to fear, anger, and disgust, although not in response to happy expressions, which did not differ from neutral ones.     

Emotional modulation of the attentional blink: the neural structures involved in capturing and holding attention

Perceiving a first target stimulus (T1) in a rapid serial visual presentation stream results in a transient impairment in detecting a second target (T2). This “attentional blink” is modulated by the emotional relevance of T1 and T2. The present experiment examined the neural underpinnings of the emotional modulation of the attentional blink. Behaviorally, the attentional blink was reduced for emotional T2 while emotional T1 led to a prolonged attentional blink. Using functional magnetic resonance imaging, we observed amygdala activation associated with the reduced attentional blink for emotional T2 in the face of neutral T1. The prolonged attentional blink following emotional T1 was correlated with enhanced activity in a cortical network including the anterior cingulate cortex, the insula and the orbitofrontal cortex. These results suggest that brain areas previously implicated in rather reflexive emotional reactions are responsible for the reduced attentional blink for emotional T2 whereas neural structures previously related to higher level processing of emotional information mediate the prolonged attentional blink following emotional T1.     

Single-Unit Recordings Reveal the Selectivity of a Human Face Area

The exquisite capacity of primates to detect and recognize faces is crucial for social interactions. Although disentangling the neural basis of human face recognition remains a key goal in neuroscience, direct evidence at the single-neuron level is limited. We recorded from face-selective neurons in human visual cortex in a region characterized by functional magnetic resonance imaging (fMRI) activations for faces compared with objects. The majority of visually responsive neurons in this fMRI activation showed strong selectivity at short latencies for faces compared with objects. Feature-scrambled faces and face-like objects could also drive these neurons, suggesting that this region is not tightly tuned to the visual attributes that typically define whole human faces. These single-cell recordings within the human face processing system provide vital experimental evidence linking previous imaging studies in humans and invasive studies in animal models.SIGNIFICANCE STATEMENT We present the first recordings of face-selective neurons in or near an fMRI-defined patch in human visual cortex. Our unbiased multielectrode array recordings (i.e., no selection of neurons based on a search strategy) confirmed the validity of the BOLD contrast (faces–objects) in humans, a finding with implications for all human imaging studies. By presenting faces, feature-scrambled faces, and face-pareidolia (perceiving faces in inanimate objects) stimuli, we demonstrate that neurons at this level of the visual hierarchy are broadly tuned to the features of a face, independent of spatial configuration and low-level visual attributes.     

Human neural systems for face recognition and social communication.

Face perception is mediated by a distributed neural system in humans that consists of multiple, bilateral regions. The functional organization of this system embodies a distinction between the representation of invariant aspects of faces, which is the basis for recognizing individuals, and the representation of changeable aspects, such as eye gaze, expression, and lip movement, which underlies the perception of information that facilitates social communication. The system also has a hierarchical organization. A core system, consisting of occipitotemporal regions in extrastriate visual cortex, mediates the visual analysis of faces. An extended system consists of regions from neural systems for other cognitive functions that can act in concert with the core system to extract meaning from faces. Of regions in the extended system for face perception, the amygdala plays a central role in processing the social relevance of information gleaned from faces, particularly when that information may signal a potential threat.     

Frontolimbic responses to emotional face memory: The neural correlates of first impressions

First impressions, especially of emotional faces, may critically impact later evaluation of social interactions. Activity in limbic regions, including the amygdala and ventral striatum, has previously been shown to correlate with identification of emotional content in faces; however, little work has been done describing how these signals may influence emotional face memory. We report an event‐related functional magnetic resonance imaging study in 21 healthy adults where subjects attempted to recognize a neutral face that was previously viewed with a threatening (angry or fearful) or nonthreatening (happy or sad) affect. In a hypothesis‐driven region of interest analysis, we found that neutral faces previously presented with a threatening affect recruited the left amygdala. In contrast, faces previously presented with a nonthreatening affect activated the left ventral striatum. A whole‐brain analysis revealed increased response in the right orbitofrontal cortex to faces previously seen with threatening affect. These effects of prior emotion were independent of task performance, with differences being seen in the amygdala and ventral striatum even if only incorrect trials were considered. The results indicate that a network of frontolimbic regions may provide emotional bias signals during facial recognition. Hum Brain Mapp, 2009. © 2009 Wiley‐Liss, Inc.     

Neuroanatomical correlates of individual differences in social anxiety in a non-clinical population

Socially anxious individuals are characterized as those with distorted negative self-beliefs (NSBs), which are thought to enhance reactions of social distress (emotional reactivity) and social avoidance (social functioning). However, it remains unclear whether individual differences in social distress and social avoidance are represented by differences in brain morphometry. To probe into these neural correlates, we analyzed magnetic resonance images of a sample of 130 healthy subjects and used the Connectome Computation System (CCS) to evaluate these factors. The results showed that social distress was correlated with the cortical volume of the right orbitofrontal cortex (OFC) and the subcortical volume of the left amygdala, while social avoidance was correlated with the cortical volume of the right dorsolateral prefrontal cortex (DLPFC). Additionally, loneliness might mediate the relationship between the amygdala volume and the social distress score. Our results demonstrated that social distress and social avoidance were represented by segregated cortical regions in the healthy individuals. These findings might provide a valuable basis for understanding the stable brain structures underlying individual differences in social anxiety.     

Threat-related amygdala functional connectivity is associated with 5-HTTLPR genotype and neuroticism

Communication between the amygdala and other brain regions critically regulates sensitivity to threat, which has been associated with risk for mood and affective disorders. The extent to which these neural pathways are genetically determined or correlate with risk-related personality measures is not fully understood. Using functional magnetic resonance imaging, we evaluated independent and interactive effects of the 5-HTTLPR genotype and neuroticism on amygdala functional connectivity during an emotional faces paradigm in 76 healthy individuals. Functional connectivity between left amygdala and medial prefrontal cortex (mPFC) and between both amygdalae and a cluster including posterior cingulate cortex, precuneus and visual cortex was significantly increased in 5-HTTLPR S′ allele carriers relative to L_AL_A individuals. Neuroticism was negatively correlated with functional connectivity between right amygdala and mPFC and visual cortex, and between both amygdalae and left lateral orbitofrontal (lOFC) and ventrolateral prefrontal cortex (vlPFC). Notably, 5-HTTLPR moderated the association between neuroticism and functional connectivity between both amygdalae and left lOFC/vlPFC, such that S′ carriers exhibited a more negative association relative to L_AL_A individuals. These findings provide novel evidence for both independent and interactive effects of 5-HTTLPR genotype and neuroticism on amygdala communication, which may mediate effects on risk for mood and affective disorders.     

Spatial scene representations formed by self‐organizing learning in a hippocampal extension of the ventral visual system

We show in a unifying computational approach that representations of spatial scenes can be formed by adding an additional self‐organizing layer of processing beyond the inferior temporal visual cortex in the ventral visual stream without the introduction of new computational principles. The invariant representations of objects by neurons in the inferior temporal visual cortex can be modelled by a multilayer feature hierarchy network with feedforward convergence from stage to stage, and an associative learning rule with a short‐term memory trace to capture the invariant statistical properties of objects as they transform over short time periods in the world. If an additional layer is added to this architecture, training now with whole scenes that consist of a set of objects in a given fixed spatial relation to each other results in neurons in the added layer that respond to one of the trained whole scenes but do not respond if the objects in the scene are rearranged to make a new scene from the same objects. The formation of these scene‐specific representations in the added layer is related to the fact that in the inferior temporal cortex and, we show, in the VisNet model, the receptive fields of inferior temporal cortex neurons shrink and become asymmetric when multiple objects are present simultaneously in a natural scene. This reduced size and asymmetry of the receptive fields of inferior temporal cortex neurons also provides a solution to the representation of multiple objects, and their relative spatial positions, in complex natural scenes.     

Neural mechanisms of facial recognition]

We review recent researches in neural mechanisms of facial recognition in the light of three aspects: facial discrimination and identification, recognition of facial expressions, and face perception in itself. First, it has been demonstrated that the fusiform gyrus has a main role of facial discrimination and identification. However, whether the FFA (fusiform face area) is really a special area for facial processing or not is controversial; some researchers insist that the FFA is related to 'becoming an expert' for some kinds of visual objects, including faces. Neural mechanisms of prosopagnosia would be deeply concerned to this issue. Second, the amygdala seems to be very concerned to recognition of facial expressions, especially fear. The amygdala, connected with the superior temporal sulcus and the orbitofrontal cortex, appears to operate the cortical function. The amygdala and the superior temporal sulcus are related to gaze recognition, which explains why a patient with bilateral amygdala damage could not recognize only a fear expression; the information from eyes is necessary for fear recognition. Finally, even a newborn infant can recognize a face as a face, which is congruent with the innate hypothesis of facial recognition. Some researchers speculate that the neural basis of such face perception is the subcortical network, comprised of the amygdala, the superior colliculus, and the pulvinar. This network would relate to covert recognition that prosopagnosic patients have.     

Motivating forces of human actions. Neuroimaging reward and social interaction

In neuroeconomics, reward and social interaction are central concepts to understand what motivates human behaviour. Both concepts are investigated in humans using neuroimaging methods. In this paper, we provide an overview about these results and discuss their relevance for economic behaviour. For reward it has been shown that a system exists in humans that is involved in predicting rewards and thus guides behaviour, involving a circuit including the striatum, the orbitofrontal cortex and the amygdala. Recent studies on social interaction revealed a mentalizing system representing the mental states of others. A central part of this system is the medial prefrontal cortex, in particular the anterior paracingulate cortex. The reward as well as the mentalizing system is engaged in economic decision-making. We will discuss implications of this study for neuromarketing as well as general implications of these results that may help to provide deeper insights into the motivating forces of human behaviour.     

A preliminary study of orbitofrontal activation and hypersociability in Williams Syndrome

Individuals with Williams syndrome (WS) demonstrate an abnormally positive social bias. However, the neural substrates of this hypersociability, i.e., positive attribution bias and increased drive toward social interaction, have not fully been elucidated. METHODS: We performed an event-related functional magnetic resonance imaging study while individuals with WS and typically developing controls (TD) matched positive and negative emotional faces. WS compared to TD showed reduced right amygdala activation during presentation of negative faces, as in the previous literature. In addition, WS showed a unique pattern of right orbitofrontal cortex activation. While TD showed medial orbitofrontal cortex activation in response to positive, and lateral orbitofrontal cortex activation to negative, WS showed the opposite pattern. In light of the general notion of a medial/lateral gradient of reward/punishment processing in the orbitofrontal cortex, these findings provide an additional biological explanation for, or correlate of positive attribution bias and hypersociability in WS.     

A developmental examination of gender differences in brain engagement during evaluation of threat.

BACKGROUND: Females appear to be more sensitive and responsive to social cues, including threat signals, than are males. Recent theoretical models suggest that developmental changes in brain functioning play important roles in the emergence of such gender differences. METHODS: We used functional magnetic resonance imaging to examine developmental and gender differences in activation of neural structures thought to mediate attention to emotional faces depicting varying degrees of threat. Analyses focused on the orbitofrontal cortex, amygdala, and anterior cingulate cortex during the evaluation of threat conveyed by faces. Healthy adolescents (n = 17; 53% male) and adults (n = 17; 53% male) were scanned while they rated how threatening pictures of neutral and emotional (angry, fearful, or happy) faces appeared. RESULTS: Results indicate significant interactions among age, gender, and face type for activation during explicit threat monitoring. In particular, adult women activated orbitofrontal cortex and amygdala selectively to unambiguous threat (angry) cues, while adult men showed a less discriminating pattern of activation. No gender differences were evident for adolescents, who as a group resembled adult males. CONCLUSIONS: These findings suggest that there are gender differences in patterns of neural responses to emotional faces that are not fully apparent until adulthood.     

The neural basis of maternal responsiveness to infants: an fMRI study

Using fMRI, we examined the neural correlates of maternal responsiveness. Ten healthy mothers viewed alternating blocks of video: (i) 40 s of their own infant; (ii) 20 s of a neutral video; (iii) 40 s of an unknown infant and (iv) 20 s of neutral video, repeated 4 times. Predominant BOLD signal change to the contrasts of infants minus neutral stimulus occurred in bilateral visual processing regions (BA 19,21,37,38); to own infant minus unknown infant in right anterior temporal pole (BA 38), left amygdala and visual cortex (BA 19), and to the unknown infant minus own infant contrast in bilateral orbitofrontal cortex (BA 10,47) and medial prefrontal cortex (BA 8) [corrected] These findings suggest that amygdala and temporal pole may be key sites in mediating a mother's response to her infant and reaffirms their importance in face emotion processing and social behaviour.     

Attraction to sexual pheromones and associated odorants in female mice involves activation of the reward system and basolateral amygdala

Adult female mice are innately attracted to non-volatile pheromones contained in male-soiled bedding. In contrast, male-derived volatiles become attractive if associated with non-volatile attractive pheromones, which act as unconditioned stimulus in a case of Pavlovian associative learning. In this work, we study the chemoinvestigatory behaviour of female mice towards volatile and non-volatile chemicals contained in male-soiled bedding, in combination with the analysis of c-fos expression induced by such a behaviour to clarify: (i) which chemosensory systems are involved in the detection of the primary attractive non-volatile pheromone and of the secondarily attractive volatiles; (ii) where in the brain male-derived non-volatile and volatile stimuli are associated to induce conditioned attraction for the latter; and (iii) whether investigation of these stimuli activates the cerebral reward system (mesocorticolimbic system including the prefrontal cortex and amygdala), which would support the view that sexual pheromones are reinforcing. The results indicate that non-volatile pheromones stimulate the vomeronasal system, whereas air-borne volatiles activate only the olfactory system. Thus, the acquired preference for male-derived volatiles reveals an olfactory-vomeronasal associative learning. Moreover, the reward system is differentially activated by the primary pheromones and secondarily attractive odorants. Exploring the primary attractive pheromone activates the basolateral amygdala and the shell of nucleus accumbens but neither the ventral tegmental area nor the orbitofrontal cortex. In contrast, exploring the secondarily attractive male-derived odorants involves activation of a circuit that includes the basolateral amygdala, prefrontal cortex and ventral tegmental area. Therefore, the basolateral amygdala stands out as the key centre for vomeronasal-olfactory associative learning.     

A non-reward attractor theory of depression

A non-reward attractor theory of depression is proposed based on the operation of the lateral orbitofrontal cortex and supracallosal cingulate cortex. The orbitofrontal cortex contains error neurons that respond to non-reward for many seconds in an attractor state that maintains a memory of the non-reward. The human lateral orbitofrontal cortex is activated by non-reward during reward reversal, and by a signal to stop a response that is now incorrect. Damage to the human orbitofrontal cortex impairs reward reversal learning. Not receiving reward can produce depression. The theory proposed is that in depression, this lateral orbitofrontal cortex non-reward system is more easily triggered, and maintains its attractor-related firing for longer. This triggers negative cognitive states, which in turn have positive feedback top-down effects on the orbitofrontal cortex non-reward system. Treatments for depression, including ketamine, may act in part by quashing this attractor. The mania of bipolar disorder is hypothesized to be associated with oversensitivity and overactivity in the reciprocally related reward system in the medial orbitofrontal cortex and pregenual cingulate cortex.     

The neural substrates of affective processing toward positive and negative affective pictures in patients with major depressive disorder

Previous studies examining neural responses to emotional stimuli in individuals with major depressive disorder (MDD) have indicated increased responses within the left amygdala to sad faces, and increased activity within the visual cortex and striatum to expressions of happiness. Using functional magnetic resonance imaging (fMRI), the current study measured neural responses to neutral, positive and negative pictures of the International Affective Picture System in 15 healthy individuals and 15 patients with MDD. Depressed individuals demonstrated lower activity in the right hippocampus and the right insula to negative affective pictures, whereas they showed lower activity in the right anterior cingulate cortex and the left insula to positive pictures. However, within the MDD group, the severity of depression correlated with the activity of the left amygdala, bilateral inferior orbitofrontal areas, and the left insula to negative pictures, whereas there were no clear indications of association between specific cerebral regions and positive pictures. Our findings indicate that preferential decreases in the left amygdala in response to negative pictures might be involved in the processing of emotional stimuli in depressed individuals. Also, these findings suggest that the bilateral inferior orbitofrontal cortices and left amygdala may be preferentially recruited in MDD patients, but not in healthy individuals.