Crossmodal transfer of emotion by music

Music is one of the most powerful elicitors of subjective emotion, yet it is not clear whether emotions elicited by music are similar to emotions elicited by visual stimuli. This leads to an open question: can music-elicited emotion be transferred to and/or influence subsequent vision-elicited emotional processing? Here we addressed this question by investigating processing of emotional faces (neutral, happy and sad) primed by short excerpts of musical stimuli (happy and sad). Our behavioural experiment showed a significant effect of musical priming: prior listening to a happy (sad) music enhanced the perceived happiness (sadness) of a face irrespective of facial emotion. Further, this musical priming-induced effect was largest for neutral face. Our electrophysiological experiment showed that such crossmodal priming effects were manifested by event related brain potential components at a very early (within 100 ms post-stimulus) stages of neuronal information processing. Altogether, these results offer new insight into the crossmodal nature of music and its ability to transfer emotion to visual modality.     

Event-related skin conductance responses to musical emotions in humans

While the reasons underlying musical emotions are unclear, music is nevertheless a powerful elicitor of emotion, and as such, may induce autonomic nervous system responses. One typical measure of this neural pathway is the skin conductance response (SCR). This response generally depends upon stimulus arousal, one of the two motivational determinants of emotion. The objective of the present study was to verify whether emotional reactions to music elicit such event-related autonomic responses. To this aim, four musical emotions varying in arousal were employed: fear, happiness, sadness and peacefulness. SCRs were found to be greater with the two more stimulating emotions, fear and happiness, as compared to the two more relaxing emotions, sadness and peacefulness (P<0.05). In addition, subjects' ratings of the emotional clarity for each excerpt did not parallel the corresponding SCRs magnitudes. The results show that SCRs can be evoked and modulated by musical emotional arousal, but are not sensitive to emotional clarity. While several studies have been performed with visual scenes and environmental sounds, the present study brings similar evidence from the musical domain.     

Increased corticospinal excitability induced by unpleasant visual stimuli

Pleasant and unpleasant emotional stimuli are frequently conceptualized as motivators for action. This notion was examined using focal transcranial magnetic stimulation (TMS). Ten healthy participants viewed pleasant, neutral, and unpleasant pictures from the International Affective Picture System (IAPS). During picture viewing, focal TMS was applied to the right motor cortex over the area innervating the first dorsal interosseous muscle of the left hand. Corticomotor excitability was larger while viewing negative pictures than while viewing neutral or positive images, as evidenced by greater motor evoked potentials. No difference was found between pleasant and neutral pictures. These results are consistent with models of emotion in which the neural networks underlying negative emotions have selective, direct connections to brain structures that mediate motor responses.     

Facial reactions, autonomic activity and experienced emotion: a three component model of emotional conditioning

The present study was designed to evaluate whether aversively conditioned responses to facial stimuli are detectable in all three components of the emotional response system, i.e. the expressive/behavioral, the physiological/autonomic and the cognitive/experienced component of emotion. Two groups of subjects were conditioned to angry or happy facial expression stimuli using a 100 dB noise as UCS in a differential aversive conditioning paradigm. The three components of the emotional response system were measured as: Facial-EMG reactions (corrugator and zygomatic muscle regions); autonomic activity (skin conductance, SCR; SCR half recovery time, T/2; heart rate, HR); and ratings of experienced emotion. It was found that responses in all components of the emotional response system were detectable in the angry group as greater EMG and autonomic resistance to extinction and greater self-reported fear. More specifically the angry group showed a resistant conditioning effect for the facial-EMG corrugator muscle that was accompanied by resistant conditioning for SCR frequency, slower SCR recovery, resistant conditioning in HR and a higher self-reported fear than the happy group. Thus, aversive conditioning to angry facial stimuli induce a uniform negative emotional response pattern as indicated by all three components of the emotional response system. These data suggest that a negative 'affect program' triggers responses in the different emotional components. The results suggest that human subjects are biologically prepared to react with a negative emotion to angry facial stimuli.     

Age differences in perception and awareness of emotion

We investigated the effects of age and gender on emotional perception and physiology using electrodermal skin conductance response (SCR) and examined whether SCR is related to subjective perceptions of emotional pictures. Older adults found pictures to be more positive and arousing than younger participants. Older women rated pictures more extremely at both ends of the valence continuum: they rated positive pictures more positively and negative pictures more negatively. Elders were less likely to show measurable SCRs. However, magnitude of SCRs when a response occurred did not differ between young and old. Subjective ratings of emotion correlated with physiological responses in younger participants, but they were unrelated in older participants. Thus, in older adults the perception of emotional events was disconnected from the physiological state induced by emotion.     

Affective modulation of brain potentials to painful and nonpainful stimuli

In accordance with the emotional priming hypothesis, emotions seem to modulate pain perception and pain tolerance thresholds. To further evaluate this association, event-related brain potentials (ERPs) elicited by painful and nonpainful electrical stimuli during processing of positive, neutral, and negative valenced pictures were recorded from 30 healthy volunteers. Valence of pictures affected pain ratings and the N150 elicited by painful stimuli, with lowest amplitudes for positive pictures and highest amplitudes for negative pictures. The P260 elicited by painful and nonpainful stimuli was modulated by arousal with reduced amplitudes with arousing (positive or negative) compared to neutral pictures. N150 amplitudes varying with picture valence seem to reflect an affective modulation of pain perception whereas P260 amplitudes varying with picture arousal rather reflect non-pain-specific attentional processes.     

Music and emotion: electrophysiological correlates of the processing of pleasant and unpleasant music

Human emotion and its electrophysiological correlates are still poorly understood. The present study examined whether the valence of perceived emotions would differentially influence EEG power spectra and heart rate (HR). Pleasant and unpleasant emotions were induced by consonant and dissonant music. Unpleasant (compared to pleasant) music evoked a significant decrease of HR, replicating the pattern of HR responses previously described for the processing of emotional pictures, sounds, and films. In the EEG, pleasant (contrasted to unpleasant) music was associated with an increase of frontal midline (Fm) theta power. This effect is taken to reflect emotional processing in close interaction with attentional functions. These findings show that Fm theta is modulated by emotion more strongly than previously believed.     

Subjective and physiological responses to emotion-eliciting pictures in male schizophrenic patients.

Several studies have shown that schizophrenic patients have difficulties in their ability to recognize emotional facial expressions, whereas other research indicated that they subjectively report the same emotional experience as healthy controls. The purpose of this study was to investigate whether the physiological responses that accompany emotions differ between schizophrenic patients and controls, which would suggest a different basic emotional processing mechanism in these patients. We presented 40 emotion-eliciting pictures to male patients (n=26) and controls (n=21), while measuring heart rate (HR), breathing rate (BR), skin conductance response (SCR) and systolic blood pressure (SBP). Each subject rated each picture for its degree of valence and arousal. Mixed-effects regression models were used to investigate the relationships between the subjective ratings and the physiological responses. In both groups, BR and SCR increased with increasing arousal ratings, suggesting sympathetic activation. The SBP of both groups increased with increases in both the valence and the arousal ratings. However, whereas the patients' HR first decreased with decreasing pleasure ratings and subsequently increased with higher arousal and valence ratings, the HR in the control group was influenced by a complex interaction between valence and arousal ratings. Thus, the schizophrenic patients showed similar relationships between subjective ratings and SCR, BR, and SBP, but a different relationship between subjective ratings and HR compared with the healthy controls.     

Decreased P3 amplitudes elicited by negative facial emotion in manic patients: Selective deficits in emotional processing

Manic patients have impairments in recognizing negative emotional stimuli. However, there have been few studies on manic patients’ neurophysiological responses to facial emotions. We measured the P3 event-related potentials using facial emotional stimuli to investigate whether the impairment in recognition of negative emotions is greater in maniac patients. We recruited twenty manic patients and twenty controls. A visual oddball paradigm was used with facial pictures: happy, neutral, sad, fear, and disgust emotions. While P3 amplitudes of emotional stimuli were significantly larger than those of neutral stimuli in controls, the amplitudes were not significantly different from those for neutral pictures in manic patients. Repeated-measures analysis of variance on P3 amplitudes revealed significant interaction effects of paired emotions as sad-neutral, disgust-neutral, fear-neutral, but not in the happy-neutral emotion pairs. These differential P3 responses suggest that manic patients may have abnormal neurophysiological activity when evaluating negative facial emotions. Thus, these findings may give the evidence for reduced negative emotion recognition of manic patients.     

Respiratory sinus arrhythmia responses to induced emotional states: effects of RSA indices, emotion induction method, age, and sex

The literature shows large inconsistencies in respiratory sinus arrhythmia (RSA) responses to induced emotional states. This may be caused by differences in emotion induction methods, RSA quantification, and non-emotional demands of the situation. In 83 healthy subjects, we studied RSA responses to pictures and film fragments eliciting six different discrete emotions relative to neutral baseline stimuli. RSA responses were quantified in the time and frequency domain and were additionally corrected for differences in mean heart rate and respiration rate, resulting in eight different RSA response measures. Subjective ratings of emotional stimuli and facial electromyographic responses indicated that pictures and film fragments elicited the intended emotions. Although RSA measures showed various emotional effects, responses were quite heterogeneous and frequently nonsignificant. They were substantially influenced by methodological factors, in particular time vs. frequency domain response measures, correction for changes in respiration rate, use of pictures vs. film fragments, and sex of participants.     

The specificity of infant emotional expression for emotion perception.

Attachment theory emphasizes the role of negative emotional expression in infancy for establishing proximity to and care of the caregiver. According to Lang's biphasic model of emotions protective reflexes (e.g. startle response) are primed if a defensive motivational set is activated. The aim of the study was to examine whether the perception of an infant emotional expression can prime such defensive behavior. The sample consisted of 48 university students. Startle reflex, corrugator and zygomatic EMG activity and subjective ratings of valence and arousal were assessed as a response to presentation of pictures of different emotional valence. Affective startle modulation was obtained when probes were presented during pictures of the International Affective Pictures System replicating previous findings. By contrast, negative infant emotion pictures did not prompt an augmentation of the startle response, although both the subjective ratings and the mimic EMG activity indicated a clear differentiation between negative and positive infant pictures. This pattern of findings was found only in a between-subject design, but not when the two picture sets were presented in the same session, indicating an interference of contrasting content of pictures.     

Uncovering the relationship between defence and orienting in emotion: cardiac reactivity to unpleasant pictures.

This research was aimed at studying the relationship between the cardiovascular reactivity to an intense auditory stimulus and the subsequent cardiac response evoked by affective visual stimuli in fifty-five subjects who underwent a cardiac reactivity task (presentation of an intense acoustic stimulus), followed by a picture viewing task (54 pictures selected from the International Affective Picture System). Heart rate (HR), electrodermal activity and corrugator supercilii electromyographic activity were recorded. Subjects were divided into two groups - high accelerators and low accelerators - on the basis of the first heart rate acceleration obtained in the cardiac reactivity task. Pictures evoked different cardiac response patterns in each subject group. Unpleasant pictures promoted a lower initial HR deceleration and a higher final acceleration in high accelerators than in low accelerators. This pattern of response was more marked with body damage pictures. Moreover, a relationship was found between the first acceleration promoted by the acoustic stimulus and the HR response waveform to the body damage pictures. These results show that, in an unselected sample of subjects, a subgroup tended to respond to loud stimuli with higher HR acceleration and sympathetic activation and to respond defensively to unpleasant pictures (as found by less initial HR deceleration and higher final HR acceleration), rather than manifesting an orienting response. The elicitation of the defence response by a brain fear system, in which the amygdala is a key structure, is also discussed.     

Alexithymic features and automatic amygdala reactivity to facial emotion

Alexithymic individuals have difficulties in identifying and verbalizing their emotions. The amygdala is known to play a central role in processing emotion stimuli and in generating emotional experience. In the present study automatic amygdala reactivity to facial emotion was investigated as a function of alexithymia (as assessed by the 20-Item Toronto Alexithymia Scale). The Beck-Depression Inventory (BDI) and the State-Trait-Anxiety Inventory (STAI) were administered to measure participants' depressivity and trait anxiety. During 3T fMRI scanning, pictures of faces bearing sad, happy, and neutral expressions masked by neutral faces were presented to 21 healthy volunteers. The amygdala was selected as the region of interest (ROI) and voxel values of the ROI were extracted, summarized by mean and tested among the different conditions. A detection task was applied to assess participants' awareness of the masked emotional faces shown in the fMRI experiment. Masked sad and happy facial emotions led to greater right amygdala activation than masked neutral faces. The alexithymia feature difficulties identifying feelings was negatively correlated with the neural response of the right amygdala to masked sad faces, even when controlling for depressivity and anxiety. Reduced automatic amygdala responsivity may contribute to problems in identifying one's emotions in everyday life. Low spontaneous reactivity of the amygdala to sad faces could implicate less engagement in the encoding of negative emotional stimuli.     

Interoceptive sensitivity and emotion processing: an EEG study.

Theories of emotion consider the self-perception of visceral activity to play an important role in emotion. This study examined the relationship between interoceptive sensitivity and both the subjective emotional experience and the processing of emotional pictures. According to their results in a heartbeat detection task subjects were classified as good (N = 17) or poor (N = 20) heartbeat perceivers. Event-related potentials were recorded while subjects viewed pleasant, neutral and unpleasant pictures and SAM ratings were examined. Good heartbeat perceivers showed significantly greater P300 and slow wave amplitudes for emotional pictures at antero-inferior, medial and posterior electrode sites and experienced a greater arousal for emotional pictures compared to poor heartbeat perceivers. The heartbeat perception score correlated significantly positive both with emotional P300 and slow wave amplitudes as well as with the arousal ratings for emotional pictures. The results indicate that there is a significant and strong association between interoceptive sensitivity and the intensity of emotional experience as well as the central processing of emotional stimuli.     

The influence of attention and arousal on emotion perception in adults with severe traumatic brain injury

Many people with traumatic brain injury (TBI) have poor emotion recognition, with negative emotions more frequently impaired. They can also display abnormal affective responses to emotionally charged material, however, the mechanisms underpinning such deficits are unclear. This study examined whether affective responsivity can be improved by focusing attention and whether responsivity is associated with perception accuracy. Eighteen adults with moderate-to-severe TBI and 18 control participants viewed facial expressions while skin conductance (SCR) and evoked cardiac deceleration (ECD) (used as indices of orientation) and skin conductance levels (SCL) (used as an index of phasic arousal) were monitored. They viewed two blocks of faces (8 angry and 8 happy per block), passively in the first block and with the instruction to identify the emotional expression in the second. No differences between conditions, emotions or groups were found using SCR. Both groups demonstrated increasing ECD for the attend condition relative to the passive condition. For the passive task the control group showed increasing SCL (sensitisation) over trials when viewing angry faces and decreasing SCL (habituation) to happy faces. No differences between emotions were shown for the TBI group who rapidly habituated to both expressions. For the attend task, there was no evidence of habituation for either expression for either the control or TBI participants. Physiological measures did not correlate to accuracy in recognising emotions. The results suggest that increasing attentional demands improves orientation and emotional engagement (arousal) to emotional faces following TBI. However, the relationship to this and emotion perception accuracy remains unclear.     

What our eyes tell us about feelings: Tracking pupillary responses during emotion regulation processes

Emotion regulation is essential for adaptive behavior and mental health. Strategies applied to alter emotions are known to differ in their impact on psychological and physiological aspects of the emotional response. However, emotion regulation outcome has primarily been assessed via self‐report, and studies comparing regulation strategies with regard to their peripheral physiological mechanisms are limited in number. In the present study, we therefore aimed to investigate the effects of different emotion regulation strategies on pupil dilation, skin conductance responses, and subjective emotional responses. Thirty healthy females were presented with negative and neutral pictures and asked to maintain or up‐ and downregulate their upcoming emotional responses through reappraisal or distraction. Pupil dilation and skin conductance responses were significantly enhanced when viewing negative relative to neutral pictures. For the pupil, this emotional arousal effect manifested specifically late during the pupillary response. In accordance with subjective ratings, increasing negative emotions through reappraisal led to the most prominent pupil size enlargements, whereas no consistent effect for downregulation was found. In contrast, early peak dilations were enhanced in all emotion regulation conditions independent of strategy. Skin conductance responses were not further modulated by emotion regulation. These results indicate that pupil diameter is modulated by emotional arousal, but is initially related to the extent of mental effort required to regulate automatic emotional responses. Our data thus provide first evidence that the pupillary response might comprise two distinct temporal components reflecting cognitive emotion regulation effort on the one hand and emotion regulation success on the other hand.     

Different time course of emotion regulation towards odors and pictures: Are odors more potent than pictures?

The present study assessed emotion regulation in response to chemosensory and visual stimuli. Using cognitive reappraisal, 40 female participants regulated their emotions in response to disgusting pictures and odors, while the startle reflex was elicited and emotion ratings were assessed. Participants reported feeling less negative, and less aroused, while down-regulating their emotions towards both odors and pictures. Although being rated as equally negative and arousing, odor presentations were accompanied by larger startle responses than picture presentations. Furthermore, as compared to pictures emotion regulation towards odors followed a strikingly different time course suggesting less effective emotion regulation in response to disgusting odors. Questionnaire data show that differences between emotion regulation outcome towards odors was not attributable to different regulation strategies used. Thus, the current data suggest a unique role of olfaction in emotion perception, and show that cognitive emotion regulation - although being generally effective - may also be limited.     

Music-induced mood modulates the strength of emotional negativity bias: an ERP study

The present study investigated the effect of music-elicited moods on the subsequent affective processing through a music-primed valence categorization task. Event-related potentials were recorded for positive and negative emotional pictures that were primed by happy or sad music excerpts. The reaction time data revealed longer reaction times (RTs) for pictures following negative versus positive music pieces, irrespective of the valence of the picture. Additionally, positive pictures elicited faster response latencies than negative pictures, irrespective of the valence of the musical prime. Moreover, the main effect of picture valence, and the music by picture valence interaction effect were both significant for P2 amplitudes and for the averaged amplitudes at 500-700ms interval. Negative pictures elicited smaller P2 amplitudes than positive pictures, and the amplitude differences between negative and positive pictures were larger with negative musical primes than with positive musical primes. Similarly, compared to positive pictures, negative pictures elicited more negative deflections during the 500-700ms interval across prime types. The amplitude differences between negative and positive pictures were again larger under negative versus positive music primes at this interval. Therefore, the present study observed a clear emotional negativity bias during either prime condition, and extended the previous findings by showing increased strength of the negative bias under negative mood primes. This suggests that the neural sensitivity of the brain to negative stimuli varies with individuals' mood states, and this bias is particularly intensified by negative mood states.     

Facial Reactions to Facial Expressions

Previous research has demonstrated that different patterns of facial muscle activity are correlated with different emotional states. In the present study subjects were exposed to pictures of happy and angry facial expressions, in response to which their facial electromyographic (EMG) activities, heart rate (HR), and palmar skin conductance responses (SCRs) were recorded. It was found that happy and angry faces evoked different facial EMG response patterns, with increased zygomatic region activity to happy stimuli and increased corrugator region activity to angry stimuli. Furthermore, both happy and angry faces evoked HR decelerations and similar SCR magnitudes. The results are interpreted as suggesting that facial EMG recordings provide a method for distinguishing between response patterns to “positive” and “negative” emotional visual stimuli.     

Common and specific brain responses to scenic emotional stimuli

Processing of emotions has been an enduring topic of interest in neuroimaging research, but studies have mostly used facial emotional stimuli. The aim of this study was to determine neural networks involved in emotion processing using scenic emotional visual stimuli. One hundred and twenty photographs from the International Affective Picture System (IAPS), including ecological scenes of disgust, fear, happiness, and sadness, were presented to 40 healthy participants while they underwent functional magnetic imaging resonance (fMRI). Afterwards they evaluated the emotional content of the pictures in an offline task. The occipito-temporal cortex and the amygdala–hippocampal complex showed a non-specific emotion-related activation, which was more marked in response to negative emotions than to happiness. The temporo-parietal cortex and the ventral anterior cingulate gyrus showed deactivation, with the former being marked for all emotions except fear and the latter being most marked for disgust. The fusiform gyrus showed activation in response to disgust and deactivation in response to happiness or sadness. Brain regions involved in processing of scenic emotion therefore resemble those reported for facial expressions of emotion in that they respond to a range of different emotions, although there appears to be specificity in the intensity and direction of the response.