Reliability of an fMRI paradigm for emotional processing in a multisite longitudinal study: Clarification and implications for statistical power

In this commentary, we clarify the meaning of the generalizability‐theory‐based coefficients reported in our multisite reliability study of fMRI measures of regional brain activation during an emotion processing task (Gee et al., Human Brain Mapping 2015;36:2558–2579). While the original paper reported generalizability and dependability coefficients based on the design of our traveling subjects study (in which each subject was scanned twice at each of eight sites), those coefficients are of limited applicability outside of the reliability study context. Here we report generalizability and dependability coefficients that represent the reliability one can expect for a multisite study, in which a given subject is scanned once on a scanner drawn randomly from the pool of available scanners (i.e., analogous to the more typical multisite study design). We also characterize the implications of a multisite versus single‐site study design for statistical power, including Figure 1 that shows sample size requirements to detect activation in two key nodes of the emotion processing circuitry given observed differences in reliability of measurement between single‐site and multisite designs.     

Attentional modulation of emotional stimulus processing: an fMRI study using emotional expectancy

We used emotional expectancy to study attentional modulation in the processing of emotional stimuli. During functional magnetic resonance imaging (fMRI), volunteers saw emotional and neutral expectancy cues signaling the subsequent presentation of corresponding emotional or neutral pictorial stimuli. As a control, emotional and neutral pictures were presented without preceding expectancy cue, resulting in a 2 x 2 factorial design with the factors "expectancy" and "emotion." Statistical analysis revealed a significant positive interaction effect between these factors in the medial prefrontal cortex (MPFC, Brodmann area [BA] 9/10), amygdala, and dorsal midbrain. In all these regions, expectancy augmented the neural response to emotional but not to neutral pictures. Time course analysis of raw data suggests that this augmented activation was not preceded by baseline increases in MPFC and amygdala during the period of emotional expectancy. In a post-scanning session, the paradigm was presented for a second time to allow emotional intensity rating. Again, a significant interaction between expectancy and emotion was observed, with intensity ratings specifically enhanced in emotional photographs preceded by expectancy. There was a positive correlation between intensity ratings and blood oxygenation level-dependent (BOLD) signals in the left amygdala. We conclude that specific components of the emotion network show enhanced activation in response to emotional stimuli when these are preceded by expectancy. This enhancement effect is not present in neutral pictures and might parallel accentuated subjective feeling states.     

ICA decomposition of EEG signal for fMRI processing in epilepsy

In this study, we introduce a new approach to process simultaneous Electroencephalography and functional Magnetic Resonance Imaging (EEG‐fMRI) data in epilepsy. The method is based on the decomposition of the EEG signal using independent component analysis (ICA) and the usage of the relevant components' time courses to define the event related model necessary to find the regions exhibiting fMRI signal changes related to interictal activity. This approach achieves a natural data‐driven differentiation of the role of distinct types of interictal activity with different amplitudes and durations in the epileptogenic process. Agreement between the conventional method and this new approach was obtained in 6 out of 9 patients that had interictal activity inside the scanner. In all cases, the maximum Z‐score was greater in the fMRI studies based on ICA component method and the extent of activation was increased in 5 out of the 6 cases in which overlap was found. Furthermore, the three cases where an agreement was not found were those in which no significant activation was found at all using the conventional approach. Hum Brain Mapp 2009. © 2009 Wiley‐Liss, Inc.     

Brain activation to briefly presented emotional words: Effects of stimulus awareness

It is unknown to what extent briefly presented emotional words can be processed without awareness. By means of two independent functional magnetic resonance imaging studies, using either a block or an event‐related design, we investigated brain activation to very briefly presented threat related and neutral words during two backward masking conditions (with and without gap between target and mask). In both experiments, emotional words were perceived during the supraliminal “with gap” condition, but they were not recognized during the subliminal “without gap” condition, as indicated by signal detection theory analysis. Imaging results of both experiments showed increased activation of the amygdala, the medial prefrontal cortex and language‐processing cortical areas to negative versus neutral words during supraliminal but not subliminal conditions. These results suggest that even very briefly presented emotional words are capable of triggering increased cortical and subcortical processing; however, only when awareness of these stimuli is given. Hum Brain Mapp 36:655–665, 2015. © 2014 Wiley Periodicals, Inc .     

The effect of presentation paradigm on syntactic processing: An event‐related fMRI study

An event‐related fMRI study was conducted to investigate the effect of two different sentence presentation paradigms—rapid serial visual presentation (RSVP) and whole sentence presentation—on syntactic processing. During scanning, sentences were presented using one of the two presentation paradigms and were followed by a short delay and a probe to verify sentence comprehension. The delay was included in an attempt to separate sentence‐related activity from probe‐related activity. The behavioral data showed a main effect of syntactic complexity for reaction time and accuracy, and accuracy revealed an interaction between complexity and the presentation paradigm employed—RSVP produced many more errors for syntactically complex sentences than did whole sentence presentation. The imaging data revealed a syntactic complexity effect during the sentence phase in left BA 44 and during the probe phase in left BA 44 and the left posterior MTG. In addition, timecourse analysis revealed that these two regions also showed an interaction between complexity and presentation paradigm such that there was no complexity effect during RSVP but a significant effect during whole sentence presentation. In addition to finding that these two presentation paradigms differentially affected syntactic processing, there were main effects within the visual pathway (V1/V2 vs. V5) and the hippocampus that revealed significant differences in activation between the paradigms. Hum Brain Mapp, 2010. © 2009 Wiley‐Liss, Inc.     

Integration of cross-modal emotional information in the human brain: an fMRI study

The interaction of information derived from the voice and facial expression of a speaker contributes to the interpretation of the emotional state of the speaker and to the formation of inferences about information that may have been merely implied in the verbal communication. Therefore, we investigated the brain processes responsible for the integration of emotional information originating from different sources. Although several studies have reported possible sites for integration, further investigation using a neutral emotional condition is required to locate emotion-specific networks. Using functional magnetic resonance imaging (fMRI), we explored the brain regions involved in the integration of emotional information from different modalities in comparison to those involved in integrating emotionally neutral information. There was significant activation in the superior temporal gyrus (STG); inferior frontal gyrus (IFG); and parahippocampal gyrus, including the amygdala, under the bimodal versus the unimodal condition, irrespective of the emotional content. We confirmed the results of previous studies by finding that the bimodal emotional condition elicited strong activation in the left middle temporal gyrus (MTG), and we extended this finding to locate the effects of emotional factors by using a neutral condition in the experimental design. We found anger-specific activation in the posterior cingulate, fusiform gyrus, and cerebellum, whereas we found happiness-specific activation in the MTG, parahippocampal gyrus, hippocampus, claustrum, inferior parietal lobule, cuneus, middle frontal gyrus (MFG), IFG, and anterior cingulate. These emotion-specific activations suggest that each emotion uses a separate network to integrate bimodal information and shares a common network for cross-modal integration.     

Investigating emotion with music: an fMRI study

The present study used pleasant and unpleasant music to evoke emotion and functional magnetic resonance imaging (fMRI) to determine neural correlates of emotion processing. Unpleasant (permanently dissonant) music contrasted with pleasant (consonant) music showed activations of amygdala, hippocampus, parahippocampal gyrus, and temporal poles. These structures have previously been implicated in the emotional processing of stimuli with (negative) emotional valence; the present data show that a cerebral network comprising these structures can be activated during the perception of auditory (musical) information. Pleasant (contrasted to unpleasant) music showed activations of the inferior frontal gyrus (IFG, inferior Brodmann's area (BA) 44, BA 45, and BA 46), the anterior superior insula, the ventral striatum, Heschl's gyrus, and the Rolandic operculum. IFG activations appear to reflect processes of music-syntactic analysis and working memory operations. Activations of Rolandic opercular areas possibly reflect the activation of mirror-function mechanisms during the perception of the pleasant tunes. Rolandic operculum, anterior superior insula, and ventral striatum may form a motor-related circuitry that serves the formation of (premotor) representations for vocal sound production during the perception of pleasant auditory information. In all of the mentioned structures, except the hippocampus, activations increased over time during the presentation of the musical stimuli, indicating that the effects of emotion processing have temporal dynamics; the temporal dynamics of emotion have so far mainly been neglected in the functional imaging literature.     

The influence of positive and negative emotional associations on semantic processing in depression: An fMRI study

In depression, patients suffer from emotional and cognitive deficits, among others in semantic processing. If these semantic deficits are cognitive or interact with emotional dysfunctions, is still an open question. The aim of the current study was to investigate the influence of emotional valence on the neural correlates of semantic priming in major depression. In a lexical decision task, positive, negative, and neutral word pairs were presented during fMRI measurement. Nineteen inpatients and 19 demographically matched controls were recruited. Behaviorally, positive and neutral valence induced a priming effect whereas negative valence induced no effect (controls) or even inhibition (slower RT for related stimuli) in patients. At the neural level, the semantic relation effect revealed similar neural activation in right middle frontal regions for patients and controls. Group differences emerged in the right fusiform gyrus and the ACC. Activity associated with positive valence differed at the DLPFC and amygdala and for negative valence at putamen and cerebellum. The activation of amygdala and DLPFC correlated negatively with the severity of depression. To conclude, semantic processing deficits in depression are modulated by emotional valence of the stimulus on the behavioral as well as on neural level in right‐lateralized prefrontal areas and the amygdala. The results highlighted an influence of depression severity on emotion information processing as the severity of symptoms correlated negatively with neural responses to positively and negatively valenced information. Hence, the dysfunctional emotion processing may further enhance the cognitive deficits in depression. Hum Brain Mapp 35:471–482, 2014. © 2012 Wiley Periodicals, Inc.     

Self-referential processing influences functional activation during cognitive control: an fMRI study

Rostral anterior cingulate cortex (rACC) plays a central role in the pathophysiology of major depressive disorder (MDD). As we reported in our previous study (Wagner et al., 2006), patients with MDD were characterized by an inability to deactivate this region during cognitive processing leading to a compensatory prefrontal hyperactivation. This hyperactivation in rACC may be related to a deficient inhibitory control of negative self-referential processes, which in turn may interfere with cognitive control task execution and the underlying fronto-cingulate network activation. To test this assumption, a functional magnetic resonance imaging study was conducted in 34 healthy subjects. Univariate and functional connectivity analyses in statistical parametric mapping software 8 were used. Self-referential stimuli and the Stroop task were presented in an event-related design. As hypothesized, rACC was specifically engaged during negative self-referential processing (SRP) and was significantly related to the degree of depressive symptoms in participants. BOLD signal in rACC showed increased valence-dependent (negative vs neutral SRP) interaction with BOLD signal in prefrontal and dorsal anterior cingulate regions during Stroop task performance. This result provides strong support for the notion that enhanced rACC interacts with brain regions involved in cognitive control processes and substantiates our previous interpretation of increased rACC and prefrontal activation in patients during Stroop task.     

Test‐retest reliability of the default mode network in a multi‐centric fMRI study of healthy elderly: Effects of data‐driven physiological noise correction techniques

Understanding how to reduce the influence of physiological noise in resting state fMRI data is important for the interpretation of functional brain connectivity. Limited data is currently available to assess the performance of physiological noise correction techniques, in particular when evaluating longitudinal changes in the default mode network (DMN) of healthy elderly participants. In this 3T harmonized multisite fMRI study, we investigated how different retrospective physiological noise correction (rPNC) methods influence the within‐site test‐retest reliability and the across‐site reproducibility consistency of DMN‐derived measurements across 13 MRI sites. Elderly participants were scanned twice at least a week apart (five participants per site). The rPNC methods were: none (NPC), Tissue‐based regression, PESTICA and FSL‐FIX. The DMN at the single subject level was robustly identified using ICA methods in all rPNC conditions. The methods significantly affected the mean z‐scores and, albeit less markedly, the cluster‐size in the DMN; in particular, FSL‐FIX tended to increase the DMN z‐scores compared to others. Within‐site test‐retest reliability was consistent across sites, with no differences across rPNC methods. The absolute percent errors were in the range of 5–11% for DMN z‐scores and cluster‐size reliability. DMN pattern overlap was in the range 60–65%. In particular, no rPNC method showed a significant reliability improvement relative to NPC. However, FSL‐FIX and Tissue‐based physiological correction methods showed both similar and significant improvements of reproducibility consistency across the consortium (ICC = 0.67) for the DMN z‐scores relative to NPC. Overall these findings support the use of rPNC methods like tissue‐based or FSL‐FIX to characterize multisite longitudinal changes of intrinsic functional connectivity. Hum Brain Mapp 37:2114–2132, 2016. © 2016 Wiley Periodicals, Inc.     

Reliability of neuroanatomical measurements in a multisite longitudinal study of youth at risk for psychosis

Multisite longitudinal neuroimaging designs are used to identify differential brain structural change associated with onset or progression of disease. The reliability of neuroanatomical measurements over time and across sites is a crucial aspect of power in such studies. Prior work has found that while within‐site reliabilities of neuroanatomical measurements are excellent, between‐site reliability is generally more modest. Factors that may increase between‐site reliability include standardization of scanner platform and sequence parameters and correction for between‐scanner variations in gradient nonlinearities. Factors that may improve both between‐ and within‐site reliability include use of registration algorithms that account for individual differences in cortical patterning and shape. In this study 8 healthy volunteers were scanned twice on successive days at 8 sites participating in the North American Prodrome Longitudinal Study (NAPLS). All sites employed 3 Tesla scanners and standardized acquisition parameters. Site accounted for 2 to 30% of the total variance in neuroanatomical measurements. However, site‐related variations were trivial (<1%) among sites using the same scanner model and 12‐channel coil or when correcting for between‐scanner differences in gradient nonlinearity and scaling. Adjusting for individual differences in sulcal‐gyral geometries yielded measurements with greater reliabilities than those obtained using an automated approach. Neuroimaging can be performed across multiple sites at the same level of reliability as at a single site, achieving within‐ and between‐site reliabilities of 0.95 or greater for gray matter density in the majority of voxels in the prefrontal and temporal cortical surfaces as well as for the volumes of most subcortical structures. Hum Brain Mapp 35:2424–2434, 2014. © 2013 Wiley Periodicals, Inc .     

fMRI analysis for motor paradigms using EMG-based designs: a validation study

The goal of the present validation study is to show that continuous surface EMG recorded simultaneously with 3T fMRI can be used to identify local brain activity related to (1) motor tasks, and to (2) muscle activity independently of a specific motor task, i.e. spontaneous (abnormal) movements. Five healthy participants performed a motor task, consisting of posture (low EMG power), and slow (medium EMG power) and fast (high EMG power) wrist flexion-extension movements. Brain activation maps derived from a conventional block design analysis (block-only design) were compared with brain activation maps derived using EMG-based regressors: (1) using the continuous EMG power as a single regressor of interest (EMG-only design) to relate motor performance and brain activity, and (2) using EMG power variability as an additional regressor in the fMRI block design analysis to relate movement variability and brain activity (mathematically) independent of the motor task. The agreement between the identified brain areas for the block-only design and the EMG-only design was excellent for all participants. Additionally, we showed that EMG power variability correlated well with activity in brain areas known to be involved in movement modulation. These innovative EMG-fMRI analysis techniques will allow the application of novel motor paradigms. This is an important step forward in the study of both the normally functioning motor system and the pathophysiological mechanisms in movement disorders.     

Brain activity underlying emotional valence and arousal: a response-related fMRI study

Emotional behavior is organized along two psychophysiologic dimensions: (1) valence, varying from negative to positive, and (2) arousal, varying from low to high. Behavioral responses along these dimensions are assumed to be mediated by different brain circuits. We recorded startle reflex modulation and skin conductance responses in healthy volunteers during functional magnetic resonance imaging (fMRI) while they viewed a set of emotional pictures and took verbal ratings of the emotional valence and arousal of each picture after scanning. Response-related multiple correlation analysis revealed differential brain activity in five brain regions. Startle reflex changes, associated with the valence of a stimulus, correlated with activity in the amygdala, while verbal reports of negative emotional valence varied with insular activity. Peripheral physiologic and verbal responses along the arousal dimension varied with thalamic and frontomedial activity. Peripheral physiologic responses along both dimensions correlated with activity in somatosensory association areas in the anterior parietal cortex. In the valence dimension, activity in the left anterior parietal cortex was associated with highly correlating peripheral physiologic and verbal responses, suggesting that verbal reports of emotional valence might depend partly on brain circuits representing peripheral physiologic changes. Our data provide direct evidence for a functional segregation of brain structures underlying peripheral physiologic responses and verbal ratings along the emotional dimensions of valence and arousal.     

Response inhibition results in the emotional devaluation of faces: neural correlates as revealed by fMRI

Although it is well established that prior experience with faces determines their subsequent social-emotional evaluation, recent work shows that top-down inhibitory mechanisms, including response inhibition, can lead to social devaluation after even a single, brief exposure. These rapidly induced effects indicate interplay among perceptual, attentional, response-selection and social-emotional networks; yet, the brain mechanisms underlying this are not well understood. This study used functional magnetic resonance imaging (fMRI) to investigate the neural mechanism mediating the relationship between inhibitory control and emotional devaluation. Participants performed two tasks: (i) a Go/No-Go task in response to faces and (ii) a trustworthiness rating task involving the previously seen faces. No-Go faces were rated as significantly less trustworthy than Go faces. By examining brain activations during Task 1, behavioral measures and brain activations obtained in Task 2 could be predicted. Specifically, activity in brain areas during Task 1 associated with (i) executive control and response suppression (i.e. lateral prefrontal cortex) and (ii) affective responses and value representation (i.e. orbitofrontal cortex), systematically covaried with behavioral ratings and amygdala activity obtained during Task 2. The present findings offer insights into the neural mechanisms linking inhibitory processes to affective responses.     

Question/statement judgments: an fMRI study of intonation processing

We examined changes in fMRI BOLD signal associated with question/statement judgments in an event‐related paradigm to investigate the neural basis of processing one aspect of intonation. Subjects made judgments about digitized recordings of three types of utterances: questions with rising intonation (RQ; e.g., “She was talking to her father?”), statements with a falling intonation (FS; e.g., “She was talking to her father.”), and questions with a falling intonation and a word order change (FQ; e.g., “Was she talking to her father?”). Functional echo planar imaging (EPI) scans were collected from 11 normal subjects. There was increased BOLD activity in bilateral inferior frontal and temporal regions for RQ over either FQ or FS stimuli. The study provides data relevant to the location of regions responsive to intonationally marked illocutionary differences between questions and statements. Hum Brain Mapping 23:85–98, 2004. © 2004 Wiley‐Liss, Inc.     

The emotional modulation of cognitive processing: an fMRI study

The functional neuroanatomy of visual processing of surface features of emotionally valenced pictorial stimuli was examined in normal human subjects using functional magnetic resonance imaging (fMRI). Pictorial stimuli were of two types: emotionally negative and neutral pictures. Task performance was slower for the negatively valenced than for the neutral pictures. Significant blood oxygen level dependent (BOLD) increases occurred in the medial and dorsolateral prefrontal cortex, midbrain, substantia innominata, and/or amygdala, and in the posterior cortical visual areas for both stimulus types. Increases were greater for the negatively valenced stimuli. While there was a small but significant BOLD decrease in the subgenual prefrontal cortex, which was larger in response to the negatively valenced pictures, there was an almost complete absence of other decreases prominently seen during the performance of demanding cognitive tasks [Shulman, G. L., Fiez, J. A., Corbetta, M., Buckner, R. L., Miezin, F. M., Raichle, M. E., & Petersen, S. E. (1997). Common blood flow changes across visual tasks: II. Decreases in cerebral cortex. Journal of Cognitive Neuroscience, 9, 648--663]. These results provide evidence that the emotional valence and arousing nature of stimuli used during the performance of an attention-demanding cognitive task are reflected in discernable, quantitative changes in the functional anatomy associated with task performance.     

Tension-related activity in the orbitofrontal cortex and amygdala: an fMRI study with music

Tonal music is characterized by a continuous flow of tension and resolution. This flow of tension and resolution is closely related to processes of expectancy and prediction and is a key mediator of music-evoked emotions. However, the neural correlates of subjectively experienced tension and resolution have not yet been investigated. We acquired continuous ratings of musical tension for four piano pieces. In a subsequent functional magnetic resonance imaging experiment, we identified blood oxygen level-dependent signal increases related to musical tension in the left lateral orbitofrontal cortex (pars orbitalis of the inferior frontal gyrus). In addition, a region of interest analysis in bilateral amygdala showed activation in the right superficial amygdala during periods of increasing tension (compared with decreasing tension). This is the first neuroimaging study investigating the time-varying changes of the emotional experience of musical tension, revealing brain activity in key areas of affective processing.     

Sex differences in visuo-spatial processing: an fMRI study of mental rotation

Following the theoretical framework of coordinate and categorical principals for visuo-spatial processing, originally formulated by [Kosslyn, S. M. (1987). Seeing and imagining in the cerebral hemispheres: AQ computational approach. Psychological Review, 94, 148-175], we present data from an fMRI study on mental rotation, using the classic [Shepard, R. N., & Metzler, J. (1971). Mental rotation of three-dimensional objects. Science, 171, 701-703] task, comparing males and females. Subjects were presented with black-and-white drawings of 3-D shapes taken from the set of 3-D perspective drawings developed by [Shepard, R. N., & Metzler, J. (1971). Mental rotation of three-dimensional objects. Science, 171, 701-703], alternated with 2-D white bars as control stimuli. The drawings were presented pairwise, as black and white drawings against a black circular background. On half of the trials, the two 3-D shapes were congruent but portrayed with different orientation, in the other half the two shapes were incongruent. Analysis of response accuracy and reaction times did not reveal any significant differences between the sexes. However, clusters of significant neuronal activation were found in the superior parietal lobule (BA 7), more intensely over the right hemisphere, and bilaterally in the inferior frontal gyrus (BA 44/45). Males showed predominantly parietal activation, while the females, in addition, showed inferior frontal activation. We suggest that males may be biased towards a coordinate processing approach, and females biased towards a serial, categorical processing approach.     

A quantitative meta-analysis of fMRI studies in bipolar disorder

Chen C‐H, Suckling J, Lennox BR, Ooi C, Bullmore ET. A quantitative meta‐analysis of fMRI studies in bipolar disorder.
Bipolar Disord 2011: 13: 1–15. © 2011 The Authors.
Journal compilation © 2011 John Wiley & Sons A/S. Objectives: Functional magnetic resonance imaging (fMRI) has been widely used to identify state and trait markers of brain abnormalities associated with bipolar disorder (BD). However, the primary literature is composed of small‐to‐medium‐sized studies, using diverse activation paradigms on variously characterized patient groups, which can be difficult to synthesize into a coherent account. This review aimed to synthesize current evidence from fMRI studies in midlife adults with BD and to investigate whether there is support for the theoretical models of the disorder. Methods: We used voxel‐based quantitative meta‐analytic methods to combine primary data on anatomical coordinates of activation from 65 fMRI studies comparing normal volunteers (n = 1,074) and patients with BD (n = 1,040). Results: Compared to normal volunteers, patients with BD underactivated the inferior frontal cortex (IFG) and putamen and overactivated limbic areas, including medial temporal structures (parahippocampal gyrus, hippocampus, and amygdala) and basal ganglia. Dividing studies into those using emotional and cognitive paradigms demonstrated that the IFG abnormalities were manifest during both cognitive and emotional processing, while increased limbic activation was mainly related to emotional processing. In further separate comparisons between healthy volunteers and patient subgroups in each clinical state, the IFG was underactive in manic but not in euthymic and depressed states. Limbic structures were not overactive in association with mood states, with the exception of increased amygdala activation in euthymic states when including region‐of‐interest studies. Conclusions: In summary, our results showed abnormal frontal‐limbic activation in BD. There was attenuated activation of the IFG or ventrolateral prefrontal cortex, which was consistent across emotional and cognitive tasks and particularly related to the state of mania, and enhanced limbic activation, which was elicited by emotional and not cognitive tasks, and not clearly related to mood states.