Additive effects of emotional content and spatial selective attention on electrocortical facilitation

Affectively arousing visual stimuli have been suggested to automatically attract attentional resources in order to optimize sensory processing. The present study crosses the factors of spatial selective attention and affective content, and examines the relationship between instructed (spatial) and automatic attention to affective stimuli. In addition to response times and error rate, electroencephalographic data from 129 electrodes were recorded during a covert spatial attention task. This task required silent counting of random-dot targets embedded in a 10 Hz flicker of colored pictures presented to both hemifields. Steady-state visual evoked potentials (ssVEPs) were obtained to determine amplitude and phase of electrocortical responses to pictures. An increase of ssVEP amplitude was observed as an additive function of spatial attention and emotional content. Statistical parametric mapping of this effect indicated occipito-temporal and parietal cortex activation contralateral to the attended visual hemifield in ssVEP amplitude modulation. This difference was most pronounced during selection of the left visual hemifield, at right temporal electrodes. In line with this finding, phase information revealed accelerated processing of aversive arousing, compared to affectively neutral pictures. The data suggest that affective stimulus properties modulate the spatiotemporal process along the ventral stream, encompassing amplitude amplification and timing changes of posterior and temporal cortex.     

Modulation of the C1 visual event-related component by conditioned stimuli: evidence for sensory plasticity in early affective perception

Previous research has demonstrated optimized processing of motivationally significant stimuli early in perception. In the present study, the time course and underlying mechanisms for such fast differentiation are of interest. We investigated the involvement of the primary visual cortex in affective evaluation of conditioned stimuli (CSs). In order to elicit learning within the visual system we chose affective pictures as unconditioned stimuli and used laterally presented gratings as CSs. Using high-density electroencephalography, we demonstrated modulation of the C1 visual event-related component for threat-related stimuli versus neutral stimuli, which increased with continuing acquisition of affective meaning. The differentiation between aversive and neutral visual stimuli occurred as early as 65-90 ms after stimulus onset and suggested involvement of the primary visual areas in affective evaluation. As an underlying mechanism, we discuss short-term reorganization in visual cortex, enabling sensory amplification of specific visual features that are related to motivationally relevant information.     

Emotional context enhances auditory novelty processing in superior temporal gyrus

Visualizing emotionally loaded pictures intensifies peripheral reflexes toward sudden auditory stimuli, suggesting that the emotional context may potentiate responses elicited by novel events in the acoustic environment. However, psychophysiological results have reported that attentional resources available to sounds become depleted, as attention allocation to emotional pictures increases. These findings have raised the challenging question of whether an emotional context actually enhances or attenuates auditory novelty processing at a central level in the brain. To solve this issue, we used functional magnetic resonance imaging to first identify brain activations induced by novel sounds (NOV) when participants made a color decision on visual stimuli containing both negative (NEG) and neutral (NEU) facial expressions. We then measured modulation of these auditory responses by the emotional load of the task. Contrary to what was assumed, activation induced by NOV in superior temporal gyrus (STG) was enhanced when subjects responded to faces with a NEG emotional expression compared with NEU ones. Accordingly, NOV yielded stronger behavioral disruption on subjects' performance in the NEG context. These results demonstrate that the emotional context modulates the excitability of auditory and possibly multimodal novelty cerebral regions, enhancing acoustic novelty processing in a potentially harming environment.     

Attentional modulation of SSVEP power depends on the network tagged by the flicker frequency

Modulation of the steady-state visual evoked potential (SSVEP) by attention was studied in detail using 15 'tag' frequencies in the range of 2.5-20 Hz. The stimuli were two series of random disc search arrays superimposed on two concentric color-marked annuli respectively. Two series of arrays were updated independently; one updated at one fixed frequency (flicker) and the other updated randomly according to a white noise distribution (random broadband flicker, rbbf). On each trial, the observer was instructed to attend one annulus and to detect a target (a triangle) that occasionally appeared in a random disc array in the attended annulus. The SSVEP results show that the choice of flicker frequency selects which cortical network synchronizes to the flicker two distinct cortical networks showed different effects of attention. SSVEP power and the effects of attention on SSVEP power strongly depend on both flicker frequency and radial position of rbbf annulus. At flicker frequencies in the delta band (2-4 Hz), and in the upper alpha band (10-11 Hz), an occipital-frontal network appears to phase-lock to the flicker when attending to the flicker, increasing the magnitude of the SSVEP. At flicker frequencies in the lower alpha band (8-10 Hz), a global response to a peripheral flickering stimulus, that includes parietal cortex and posterior frontal cortex, has higher amplitude when attention is directed away from the flickering peripheral stimulus and towards a competing rbbf stimulus in the fovea. Increases in SSVEP power when attention is directed to peripheral flicker are always associated with increases in phase locking. By contrast, at frequencies in the lower alpha band, increases in SSVEP power when attention is directed away from the flicker and towards foveal stimuli are not associated with changes in phase-locking. Thus, whether attention to a flicker stimulus increases or decreases SSVEP amplitude and phase locking depends on which of two cortical networks, which have distinct spatial and dynamic properties, is selected by the flicker frequency.     

As time goes by: temporal constraints on emotional activation of inferior medial prefrontal cortex

To investigate the influence of stimulus duration on emotional processing, we measured changes of regional cerebral blood flow (rCBF) in 14 healthy subjects who viewed neutral or emotional images presented for 3 or 6 s. Presentation for 3 s reproduced the previous result of higher rCBF in inferior medial prefrontal cortex (IMPC) during neutral than emotional stimulation. Six-second presentation reverted this relationship, with activity in IMPC being higher during emotional stimulation. Prolonged stimulus presentation attenuated the rise of rCBF associated with emotions in left parietal cortex and cerebellar hemisphere. We speculate that the different rCBF during neutral and emotional stimulation for 6 s is a consequence of attention divided between the emotional stimuli and their associations. Thus, prefrontal activity rises when a cognitive task accompanies emotional stimulation because several cognitive processes compete for attention. The IMPC may serve the mechanism of attention underlying the concept of a default mode of brain function, selecting among competitive inputs from multiple brain regions rather than just processing emotions. The results emphasize the importance of implicit cognitive processing during emotional activation, however, unintended.     

Electrophysiological evidence for temporal dissociation between spatial attention and sensory competition during human face processing

Scalp event-related potential (ERP) studies in humans indicate that face processes taking place between 130 and 170 ms after stimulus onset at posterior sites (N170) are strongly reduced when another face stimulus is processed concurrently or has been presented shortly before for a prolonged period. These observations suggest that neural representations of individual faces compete in the occipitotemporal cortex as early as 130 ms. Here, we tested the respective role of spatial attention and sensory competition in accounting for the amplitude reduction of the N170 during concurrent face stimulation. ERPs time locked to a lateralized face stimulus were recorded while subjects were fixating either a face or a controlled scrambled-face stimulus (context factor) and were engaged in either a high- or a low-attentional load task at fixation (task factor). The N170 amplitude to the lateralized face stimulus was reduced both when the central stimulus was a face compared with a scrambled face and when the attentional load at fixation was high. However, these effects of context and task factors were largely additive. Most importantly, spatial attention modulated visual processes as early as 80 ms after stimulus onset, whereas sensory competition effects started at about 130 ms. These results provide strong evidence that the N170 in response to faces is modulated by spatial attention, and also that spatial attention and sensory competition do not reflect the same mechanisms of early selection of visual information in the extrastriate cortex.     

Role of amygdala connectivity in the persistence of emotional memories over time: an event-related FMRI investigation

According to the consolidation hypothesis, enhanced memory for emotional information reflects the modulatory effect of the amygdala on the medial temporal lobe (MTL) memory system during consolidation. Although there is evidence that amygdala-MTL connectivity enhances memory for emotional stimuli, it remains unclear whether this enhancement increases over time, as consolidation processes unfold. To investigate this, we used functional magnetic resonance imaging to measure encoding activity predicting memory for emotionally negative and neutral pictures after short (20-min) versus long (1-week) delays. Memory measures distinguished between vivid remembering (recollection) and feelings of knowing (familiarity). Consistent with the consolidation hypothesis, the persistence of recollection over time (long divided by short) was greater for emotional than neutral pictures. Activity in the amygdala predicted subsequent memory to a greater extent for emotional than neutral pictures. Although this advantage did not vary with delay, the contribution of amygdala-MTL connectivity to subsequent memory for emotional items increased over time. Moreover, both this increase in connectivity and amygdala activity itself were correlated with individual differences in recollection persistence for emotional but not neutral pictures. These results suggest that the amygdala and its connectivity with the MTL are critical to sustaining emotional memories over time, consistent with the consolidation hypothesis.     

Large-scale visuomotor integration in the cerebral cortex

Efficient visuomotor behavior depends on integrated processing by the visual and motor systems of the cerebral cortex. Yet, many previous cortical neurophysiology studies have examined the visual and motor modalities in isolation, largely ignoring questions of large-scale cross-modal integration. To address this issue, we analyzed event-related local field potentials simultaneously recorded from multiple visual, motor, and executive cortical sites in monkeys performing a visuomotor pattern discrimination task. The timing and cortical location of four aspects of event-related activities were examined: stimulus-evoked activation onset, stimulus-specific processing, stimulus category-specific processing, and response-specific processing. Activations appeared earliest in striate cortex and rapidly thereafter in other visual areas. Stimulus-specific processing began early in most visual cortical areas, some at activation onset. Early onset latencies were also observed in motor, premotor, and prefrontal areas, some as early as in striate cortex, but these early-activating frontal sites did not show early stimulus-specific processing. Response-specific processing began around 150 ms poststimulus in widespread cortical areas, suggesting that perceptual decision formation and response selection arose through concurrent processes of visual, motor, and executive areas. The occurrence of stimulus-specific and stimulus category-specific differences after the onset of response-specific processing suggests that sensory and motor stages of visuomotor processing overlapped in time.     

Electrophysiological correlates of rapid spatial orienting towards fearful faces

We investigated the spatio-temporal dynamic of attentional bias towards fearful faces. Twelve participants performed a covert spatial orienting task while recording visual event-related brain potentials (VEPs). Each trial consisted of a pair of faces (one emotional and one neutral) briefly presented in the upper visual field, followed by a unilateral bar presented at the location of one of the faces. Participants had to judge the orientation of the bar. Comparing VEPs to bars shown at the location of an emotional (valid) versus neutral (invalid) face revealed an early effect of spatial validity: the lateral occipital P1 component (approximately 130 ms post-stimulus) was selectively increased when a bar replaced a fearful face compared to when the same bar replaced a neutral face. This effect was not found with upright happy faces or inverted fearful faces. A similar amplification of P1 has previously been observed in electrophysiological studies of spatial attention using non-emotional cues. In a behavioural control experiment, participants were also better at discriminating the orientation of the bar when it replaced a fearful rather than a neutral face. In addition, VEPs time-locked to the face-pair onset revealed a C1 component (approximately 90 ms) that was greater for fearful than happy faces. Source localization (LORETA) confirmed an extrastriate origin of the P1 response showing a spatial validity effect, and a striate origin of the C1 response showing an emotional valence effect. These data suggest that activity in primary visual cortex might be enhanced by fear cues as early as 90 ms post-stimulus, and that such effects might result in a subsequent facilitation of sensory processing for a stimulus appearing at the same location. These results provide evidence for neural mechanisms allowing rapid, exogenous spatial orienting of attention towards fear stimuli.     

Synchrony dynamics in monkey V1 predict success in visual detection

Behavioral measures such as expectancy and attention have been associated with the strength of synchronous neural activity. On this basis, it is hypothesized that synchronous activity affects our ability to detect and recognize visual objects. To investigate the role of synchronous activity in visual perception, we studied the magnitude and precision of correlated activity, before and after stimulus presentation within the visual cortex (V1), in relation to a monkey's performance in a figure-ground discrimination task. We show that during the period of stimulus presentation a transition in synchronized activity occurs that is characterized by a reduction of the correlation peak height and width. Before stimulus onset, broad peak correlations are observed that change towards thin peak correlations after stimulus onset, due to a specific decrease of low-frequency components. The magnitude of the transition in correlated activity is larger, i.e. a stronger desynchronization occurs, when the animal perceives the stimulus correctly than when the animal fails to detect the stimulus. These results therefore show that a transition in synchronous firing is important for the detection of sensory stimuli. We hypothesize that the transition in synchrony reflects a change from loose and global neuronal interactions towards a finer temporal and spatial scale of neuronal interactions, and that such a change in neuronal interactions is required for figure-ground discrimination.     

Hearing lips: gamma-band activity during audiovisual speech perception

Auditory pattern changes have been shown to elicit increases in magnetoencephalographic gamma-band activity (GBA) over left inferior frontal cortex, forming part of the putative auditory ventral "what" processing stream. The present study employed a McGurk-type paradigm to assess whether GBA would be associated with subjectively perceived changes even when auditory stimuli remain unchanged. Magnetoencephalograms were recorded in 16 human subjects during audiovisual mismatch perception. Both infrequent visual (auditory /ta/ + visual /pa/) and acoustic deviants (auditory/pa/ + visual /ta/) were compared with frequent audiovisual standards (auditory /ta/ and visual /ta/). Statistical probability mapping revealed spectral amplitude increases at approximately 75 and approximately 78 Hz to visual deviants. GBA to visual deviants peaked 160 ms after auditory stimulus onset over posterior parietal cortex, at 270 ms over occipital areas and at 320 ms over left inferior frontal cortex. The latter GBA enhancement was consistent with the increase observed previously to pure acoustic mismatch, supporting a role of left inferior frontal cortex for the representation of perceived auditory pattern change. The preceding gamma-band changes over posterior areas may reflect processing of incongruent lip movements in visual motion areas and back-projections to earlier visual cortex.     

Enhanced processing of threat stimuli under limited attentional resources

The ability to process stimuli that convey potential threat, under conditions of limited attentional resources, confers adaptive advantages. This study examined the neurobiology underpinnings of this capacity. Employing an attentional blink paradigm, in conjunction with functional magnetic resonance imaging, we manipulated the salience of the second of 2 face target stimuli (T2), by varying emotionality. Behaviorally, fearful T2 faces were identified significantly more than neutral faces. Activity in fusiform face area increased with correct identification of T2 faces. Enhanced activity in rostral anterior cingulate cortex (rACC) accounted for the benefit in detection of fearful stimuli reflected in a significant interaction between target valence and correct identification. Thus, under conditions of limited attention resources activation in rACC correlated with enhanced processing of emotional stimuli. We suggest that these data support a model in which a prefrontal "gate" mechanism controls conscious access of emotional information under conditions of limited attentional resources.     

Compelled Attention: The Effects of Viewing Trauma-Related Stimuli on Concurrent Task Performance in Posttraumatic Stress Disorder

We examined the ability of Vietnam veterans with PTSD to focus attention on a primary digit detection task while concurrently viewing neutral or Vietnam-related picture and word distractors. Controlling for combat exposure, military service, and psychopathology, veterans with PTSD took longer to detect the target when Vietnam-related pictures were distractors. There were no reaction time differences when word stimuli were distractors. The latency effect was specific to trials with trauma-related pictures and did not spread to neutral trials interleaved within a mixed block of trauma and neutral pictures. Individuals with PTSD recalled proportionally more Vietnam-related words than other groups, implying differential attention to Vietnam-related words. Attending to trauma-related pictures interferes with performance of a concurrent task by individuals with PTSD.     

Monetary incentives enhance processing in brain regions mediating top-down control of attention

To evaluate the effect of an abstract motivational incentive on top-down mechanisms of visual spatial attention, 10 subjects engaged in a target detection task and responded to targets preceded by spatially valid (predictive), invalid (misleading) or neutral central cues under three different incentive conditions: win money (WIN), lose money (LOSE), and neutral (neither gain nor lose). Activation in the posterior cingulate cortex was correlated with visual spatial expectancy, defined as the degree to which the valid cue benefited performance as evidenced by faster reaction times compared to non-directional cues. Winning and losing money enhanced this relationship via overlapping but independent limbic mechanisms. In addition, activity in the inferior parietal lobule was correlated with disengagement (the degree to which invalid cues diminished performance). This relationship was also enhanced by monetary incentives. Finally, incentive enhanced the relationship of activation in the visual cortex to visual spatial expectancy and disengagement for both types of incentive (WIN and LOSE). These results show that abstract incentives enhance neural processing within the attention network in a process- and valence-selective manner. They also show that different cognitive and motivational mechanisms may produce a common effect upon unimodal cortices in order to enhance processing to serve the current behavioral goal.     

Time-locked brain activity associated with emotion: a pilot MEG study

Objective: To examine the time course of brain activation in response to emotionally evocative pictures.

Methods and procedures: Regions of the brain involved in the processing of affective stimuli in response to picture sets rated unpleasant, pleasant and affectively neutral, as well as the order of activation of each region, were investigated using magnetoencephalography in 10 normal adult volunteers.

Results: Spatiotemporal maps were found consisting of two basic components. The first involving activation in the occipital and basal aspects of the temporal cortex- lasted, on average, 270 ms post-stimulus. The second component involving activation in the mesial temporal lobes (MTL) extended from 270 to 850 ms post-stimulus. After (serial) activating the mesial temporal lobe structures or simultaneous (parallel) to it, activation is also observed in the frontal structures.

Conclusions: The temporal organization in the brain of an emotional stimulus requires the serial and alternating engagement of frontal and posterior cortices. It is suggested that lesions to the brain may disrupt this temporal course, altering the emotional response commonly observed in patients with brain injury.     

Strength of figure-ground activity in monkey primary visual cortex predicts saccadic reaction time in a delayed detection task

When and where are decisions made? In the visual system a saccade, which is a fast shift of gaze toward a target in the visual scene, is the behavioral outcome of a decision. Current neurophysiological data and reaction time models show that saccadic reaction times are determined by a build-up of activity in motor-related structures, such as the frontal eye fields. These structures depend on the sensory evidence of the stimulus. Here we use a delayed figure-ground detection task to show that late modulated activity in the visual cortex (V1) predicts saccadic reaction time. This predictive activity is part of the process of figure-ground segregation and is specific for the saccade target location. These observations indicate that sensory signals are directly involved in the decision of when and where to look.     

Rapid distributed fronto-parieto-occipital processing stages during working memory in humans

Cortical potentials were recorded from implanted electrodes during a difficult working memory task requiring rapid storage, modification and retrieval of multiple memoranda. Synchronous event-related potentials were generated in distributed occipital, parietal, Rolandic and prefrontal sites beginning approximately 130 ms after stimulus onset and continuing for >500 ms. Coherent phase-locked, event-related oscillations supported interaction between these dorsal stream structures throughout the task period. The Rolandic structures generated early as well as sustained potentials to sensory stimuli in the absence of movement. Activation peaks and phase lags between synaptic populations suggested that perceptual processing occurred exclusively in the visual association cortex from approximately 90 to 130 ms, with its results projected to fronto-parietal areas for interpretation from approximately 130 to 280 ms. The direction of interaction then appeared to reverse from approximately 300 to 400 ms, consistent with mental arithmetic being performed by fronto-parietal areas operating upon a visual scratch pad in the dorsolateral occipital cortex. A second reversal, from approximately 420 to 600 ms, may have represented an updating of memoranda stored in fronto-parietal sites. Lateralized perisylvian oscillations suggested an articulatory loop. Anterior cingulate activity was evoked by feedback signals indicating errors. These results indicate how a fronto-centro-parietal 'central executive' might interact with an occipital visual scratch pad, perisylvian articulatory loop and limbic monitor to implement the sequential stages of a complex mental operation.     

Spatial attention modulates initial afferent activity in human primary visual cortex

It is well established that spatially directed attention enhances visual perceptual processing. However, the earliest level at which processing can be affected remains unknown. To date, there has been no report of modulation of the earliest visual event-related potential component "C1" in humans, which indexes initial afference in primary visual cortex (V1). Thus it has been suggested that initial V1 activity is impenetrable, and that the earliest modulations occur in extrastriate cortex. However, the C1 is highly variable across individuals, to the extent that uniform measurement across a group may poorly reflect the dynamics of V1 activity. In the present study we employed an individualized mapping procedure to control for such variability. Parameters for optimal C1 measurement were determined in an independent, preliminary "probe" session and later applied in a follow-up session involving a spatial cueing task. In the spatial task, subjects were cued on each trial to direct attention toward 1 of 2 locations in anticipation of an imperative Gabor stimulus and were required to detect a region of lower luminance appearing within the Gabor pattern 30% of the time at the cued location only. Our data show robust spatial attentional enhancement of the C1, beginning as early as its point of onset (57 ms). Source analysis of the attentional modulations points to generation in striate cortex. This finding demonstrates that at the very moment that visual information first arrives in cortex, it is already being shaped by the brain's attentional biases.     

Responses of neurons in macaque area V4 during memory-guided visual search.

In a typical scene with many different objects, attentional mechanisms are needed to select relevant objects for visual processing and control over behavior. To test the role of area V4 in the selection of objects based on non-spatial features, we recorded from V4 neurons in the monkey, using a visual search paradigm. A cue stimulus was presented at the center of gaze, followed by a blank delay period. After the delay, a two-stimulus array was presented extrafoveally, and the monkey was rewarded for detecting the target stimulus matching the cue. The array was composed of one 'good' stimulus (effective in driving the cell when presented alone) and one 'poor' stimulus (ineffective in driving the cell when presented alone). When the choice array was presented in the receptive field (RF) of the neuron, many cells showed suppressive interactions between the stimuli as well as strong attention effects. Within 150--200 ms of array onset, responses to the array were determined by the target stimulus. If the target was the good stimulus, the response to the array became equal to the response to the good stimulus presented alone. If the target was the poor stimulus, the response approached the response to that stimulus presented alone. Thus the influence of the nontarget stimulus was filtered out. These effects were reduced or eliminated when the poor stimulus was located outside the RF and, therefore, no longer competing for the cell's response. Overall, the results support a 'biased competition' model of attention, according to which objects in the visual field compete for representation in the cortex, and this competition is biased in favor of the behaviorally relevant object.     

Neuronal responses in area 7a to multiple-stimulus displays: I. neurons encode the location of the salient stimulus.

The primate posterior parietal cortex (PPC) plays an important role in representing and recalling spatial relationships and in the ability to orient visual attention. This is evidenced by the parietal activation observed in brain imaging experiments performed during visuo- spatial tasks, and by the contralateral neglect syndrome that often accompanies parietal lesions. Individual neurons in monkey parietal cortex respond vigorously to the appearance of single, behaviorally relevant stimuli, but little is known about how they respond to more complex visual displays. The current experiments addressed this issue by recording activity from single neurons in area 7a of the PPC in monkeys performing a spatial version of a match-to-sample task. The task required them to locate salient stimuli in multiple-stimulus displays and release a lever after a subsequent stimulus appeared at the same location. Neurons responded preferentially to the appearance of salient stimuli inside their receptive fields. The presence of multiple stimuli did not affect appreciably the spatial tuning of responses in the majority of neurons or the population code for the location of the salient stimulus. Responses to salient stimuli could be distinguished from background stimuli approximately 100 ms after the onset of the cue. These results suggest that area 7a neurons represent the location of the stimulus attracting the animal's attention and can provide the spatial information required for directing attention to a salient stimulus in a complex scene.