Individual differences in sensitivity to reward and punishment and neural activity during reward and avoidance learning

In this functional neuroimaging study, we investigated neural activations during the process of learning to gain monetary rewards and to avoid monetary loss, and how these activations are modulated by individual differences in reward and punishment sensitivity. Healthy young volunteers performed a reinforcement learning task where they chose one of two fractal stimuli associated with monetary gain (reward trials) or avoidance of monetary loss (avoidance trials). Trait sensitivity to reward and punishment was assessed using the behavioral inhibition/activation scales (BIS/BAS). Functional neuroimaging results showed activation of the striatum during the anticipation and reception periods of reward trials. During avoidance trials, activation of the dorsal striatum and prefrontal regions was found. As expected, individual differences in reward sensitivity were positively associated with activation in the left and right ventral striatum during reward reception. Individual differences in sensitivity to punishment were negatively associated with activation in the left dorsal striatum during avoidance anticipation and also with activation in the right lateral orbitofrontal cortex during receiving monetary loss. These results suggest that learning to attain reward and learning to avoid loss are dependent on separable sets of neural regions whose activity is modulated by trait sensitivity to reward or punishment.     

Effects of reward sensitivity and regional brain volumes on substance use initiation in adolescence

This longitudinal study examines associations between baseline individual differences and developmental changes in reward [i.e. behavioral approach system (BAS)] sensitivity and relevant brain structures’ volumes to prospective substance use initiation during adolescence. A community sample of adolescents ages 15–18 with no prior substance use was assessed for substance use initiation (i.e. initiation of regular alcohol use and/or any use of other substances) during a 2-year follow-up period and for alcohol use frequency in the last year of the follow-up. Longitudinal ‘increases’ in BAS sensitivity were associated with substance use initiation and increased alcohol use frequency during the follow-up. Moreover, adolescents with smaller left nucleus accumbens at baseline were more likely to initiate substance use during the follow-up period. This study provides support for the link between developmental increases in reward sensitivity and substance use initiation in adolescence. The study also emphasizes the potential importance of individual differences in volumes of subcortical regions and their structural development for substance use initiation during adolescence.     

Dissociation of BOLD responses to reward prediction errors and reward receipt by a model comparison

The representation of reward anticipation and reward prediction errors is the basis for reward-associated learning. The representation of whether or not a reward occurred (reward receipt) is important for decision making. Recent studies suggest that, while reward anticipation and reward prediction errors are encoded in the midbrain and the ventral striatum, reward receipts are encoded in the medial orbitofrontal cortex. In order to substantiate this functional specialization we analyzed data from an fMRI study in which 59 subjects completed two simple monetary reward paradigms. Because reward receipts and reward prediction errors were correlated, a statistical model comparison was applied separating the effects of the two. Reward prediction error fitted BOLD responses significantly better than reward receipt in the midbrain and the ventral striatum. Conversely, reward receipt fitted BOLD responses better in the orbitofrontal cortex. Activation related to reward anticipation was found in the orbitofrontal cortex. The results confirm a functional specialization of behaviorally important aspects of reward processing within the mesolimbic dopaminergic system.     

The brain structural disposition to social interaction

Social reward dependence (RD) in humans is a stable pattern of attitudes and behaviour hypothesized to represent a favourable disposition towards social relationships and attachment as a personality dimension. It has been theorized that this long-term disposition to openness is linked to the capacity to process primary reward. Using brain structure measures from magnetic resonance imaging, and a measure of RD from Cloninger's temperament and character inventory, a self-reported questionnaire, in 41 male subjects sampled from a general population birth cohort, we investigated the neuro-anatomical basis of social RD. We found that higher social RD in men was significantly associated with increased gray matter density in the orbitofrontal cortex, basal ganglia and temporal lobes, regions that have been previously shown to be involved in processing of primary rewards. These findings provide evidence for a brain structural disposition to social interaction, and that sensitivity to social reward shares a common neural basis with systems for processing primary reward information.     

Waiting to win: elevated striatal and orbitofrontal cortical activity during reward anticipation in euthymic bipolar disorder adults

Nusslock R, Almeida JRC, Forbes EE, Versace A, Frank E, LaBarbara EJ, Klein CR, Phillips ML. Waiting to win: elevated striatal and orbitofrontal cortical activity during reward anticipation in euthymic bipolar disorder adults. Bipolar Disord 2012: 14: 249–260. © 2012 The Authors. Journal compilation © 2012 John Wiley & Sons A/S. Objective: Bipolar disorder may be characterized by a hypersensitivity to reward‐relevant stimuli, potentially underlying the emotional lability and dysregulation that characterizes the illness. In parallel, research highlights the predominant role of striatal and orbitofrontal cortical (OFC) regions in reward‐processing and approach‐related affect. We aimed to examine whether bipolar disorder, relative to healthy, participants displayed elevated activity in these regions during reward processing. Methods: Twenty‐one euthymic bipolar I disorder and 20 healthy control participants with no lifetime history of psychiatric disorder underwent functional magnetic resonance imaging (fMRI) scanning during a card‐guessing paradigm designed to examine reward‐related brain function to anticipation and receipt of monetary reward and loss. Data were collected using a 3T Siemens Trio scanner. Results: Region‐of‐interest analyses revealed that bipolar disorder participants displayed greater ventral striatal and right‐sided orbitofrontal [Brodmann area (BA) 11] activity during anticipation, but not outcome, of monetary reward relative to healthy controls (p < 0.05, corrected). Whole‐brain analyses indicated that bipolar disorder, relative to healthy, participants also displayed elevated left‐lateral OFC (BA 47) activity during reward anticipation (p < 0.05, corrected). Conclusions: Elevated ventral striatal and OFC activity during reward anticipation may represent a neural mechanism for predisposition to expansive mood and hypo/mania in response to reward‐relevant cues that characterizes bipolar disorder. Our findings contrast with research reporting blunted activity in the ventral striatum during reward processing in unipolar depressed individuals, relative to healthy controls. Examination of reward‐related neural activity in bipolar disorder is a promising research focus to facilitate identification of biological markers of the illness.     

Distinct neural responses to conscious versus unconscious monetary reward cues

Human reward pursuit is often assumed to involve conscious processing of reward information. However, recent research revealed that reward cues enhance cognitive performance even when perceived without awareness. Building on this discovery, the present functional MRI study tested two hypotheses using a rewarded mental‐rotation task. First, we examined whether subliminal rewards engage the ventral striatum (VS), an area implicated in reward anticipation. Second, we examined differences in neural responses to supraliminal versus subliminal rewards. Results indicated that supraliminal, but not subliminal, high‐value reward cues engaged brain areas involved in reward processing (VS) and task performance (supplementary motor area, motor cortex, and superior temporal gyrus). This pattern of findings is striking given that subliminal rewards improved performance to the same extent as supraliminal rewards. So, the neural substrates of conscious versus unconscious reward pursuit are vastly different—but despite their differences, conscious and unconscious reward pursuit may still produce the same behavioral outcomes. Hum Brain Mapp 35:5578–5586, 2014. © 2014 Wiley Periodicals, Inc .     

Mesolimbic recruitment by nondrug rewards in detoxified alcoholics: effort anticipation, reward anticipation, and reward delivery

Aberrant sensitivity of incentive neurocircuitry to nondrug rewards has been suggested as either a risk factor for or consequence of drug addiction. Using functional magnetic resonance imaging, we tested whether alcohol‐dependent patients (ADP: n = 29) showed altered recruitment of ventral striatal (VS) incentive neurocircuitry compared to controls (n = 23) by: (1) cues to respond for monetary rewards, (2) post‐response anticipation of rewards, or (3) delivery of rewards. Using an instrumental task with two‐stage presentation of reward‐predictive information, subjects saw cues signaling opportunities to win Aberrant sensitivity of incentive neurocircuitry to nondrug rewards has been suggested as either a risk factor for or consequence of drug addiction. Using functional magnetic resonance imaging, we tested whether alcohol‐dependent patients (ADP: n = 29) showed altered recruitment of ventral striatal (VS) incentive neurocircuitry compared to controls (n = 23) by: (1) cues to respond for monetary rewards, (2) post‐response anticipation of rewards, or (3) delivery of rewards. Using an instrumental task with two‐stage presentation of reward‐predictive information, subjects saw cues signaling opportunities to win Aberrant sensitivity of incentive neurocircuitry to nondrug rewards has been suggested as either a risk factor for or consequence of drug addiction. Using functional magnetic resonance imaging, we tested whether alcohol-dependent patients (ADP: n = 29) showed altered recruitment of ventral striatal (VS) incentive neurocircuitry compared to controls (n = 23) by: (1) cues to respond for monetary rewards, (2) post-response anticipation of rewards, or (3) delivery of rewards. Using an instrumental task with two-stage presentation of reward-predictive information, subjects saw cues signaling opportunities to win $0, $1, or $10 for responding to a target. Following this response, subjects were notified whether their success would be indicated by a lexical notification (“Hit?”) or by delivery of a monetary reward (“Win?”). After a variable interval, subjects then viewed the trial outcome. We found no significant group differences in voxelwise activation by task contrasts, or in signal change extracted from VS. Both ADP and controls showed significant VS and other limbic recruitment by pre-response reward anticipation. In addition, controls also showed VS recruitment by post-response reward-anticipation, and ADP had appreciable subthreshold VS activation. Both groups also showed similar mesolimbic responses to reward deliveries. Across all subjects, a questionnaire measure of “hot” impulsivity correlated with VS recruitment by post-response anticipation of low rewards and with VS recruitment by delivery of low rewards. These findings indicate that incentive-motivational processing of nondrug rewards is substantially maintained in recovering alcoholics, and that reward-elicited VS recruitment correlates more with individual differences in trait impulsivity irrespective of addiction.     

Association between reward‐related activation in the ventral striatum and trait reward sensitivity is moderated by dopamine transporter genotype

The impact of individual differences on human reward processing has been a focus of research in recent years, particularly, as they are associated with a variety of neuropsychiatric diseases including addiction and attention‐deficit/hyperactivity disorder. Studies exploring the neural basis of individual differences in reward sensitivity have consistently implicated the ventral striatum (VS) as a core component of the human reward system. However, the mechanisms of dopaminergic neurotransmission underlying ventral striatal activation as well as trait reward sensitivity remain speculative. We addressed this issue by investigating the triadic interplay between VS reactivity during reward anticipation using functional magnetic resonance imaging, trait reward sensitivity, and dopamine (DA) transporter genotype (40‐bp 3′VNTR of DAT, SLC6A3) affecting synaptic DA neurotransmission. Our results show that DAT variation moderates the association between VS‐reactivity and trait reward sensitivity. Specifically, homozygote carriers of the DAT 10‐repeat allele exhibit a strong positive correlation between reward sensitivity and reward‐related VS activity whereas this relationship is absent in the DAT 9‐repeat allele carriers. We discuss the possibility that this moderation of VS‐trait relation might arise from DAT‐dependent differences in DA availability affecting synaptic plasticity within the VS. Generally, studying the impact of dopaminergic gene variations on the relation between reward‐related brain activity and trait reward sensitivity might facilitate the investigation of complex mechanisms underlying disorders linked to dysregulation of DA neurotransmission. Hum Brain Mapp, 2010. © 2010 Wiley‐Liss, Inc.     

Striatum gray matter reduction in males with an overactive behavioral activation system

Using optimized voxel-based morphometry, we studied the relationship between gray matter volume in brain areas associated with reward and scores on a behavioral activation system measure (the Sensitivity to Reward scale) in a sample of 50 male undergraduates. Voxel-based morphometry analysis revealed a negative correlation between Sensitivity to Reward scores and gray matter volume in the dorsal striatum and prefrontal cortex. Results indicate that a reduced volume in the striatum might be associated with enhanced reward sensitivity and deficits in inhibitory control.     

Contextual interaction between novelty and reward processing within the mesolimbic system

Medial temporal lobe (MTL) dependent long-term memory for novel events is modulated by a circuitry that also responds to reward and includes the ventral striatum, dopaminergic midbrain, and medial orbitofrontal cortex (mOFC). This common neural network may reflect a functional link between novelty and reward whereby novelty motivates exploration in the search for rewards; a link also termed novelty "exploration bonus." We used fMRI in a scene encoding paradigm to investigate the interaction between novelty and reward with a focus on neural signals akin to an exploration bonus. As expected, reward related long-term memory for the scenes (after 24 hours) strongly correlated with activity of MTL, ventral striatum, and substantia nigra/ventral tegmental area (SN/VTA). Furthermore, the hippocampus showed a main effect of novelty, the striatum showed a main effect of reward, and the mOFC signalled both novelty and reward. An interaction between novelty and reward akin to an exploration bonus was found in the hippocampus. These data suggest that MTL novelty signals are interpreted in terms of their reward-predicting properties in the mOFC, which biases striatal reward responses. The striatum together with the SN/VTA then regulates MTL-dependent long-term memory formation and contextual exploration bonus signals in the hippocampus.     

Emotional reactivity in depression: diminished responsiveness to anticipated reward but not to anticipated punishment or to nonreward or avoidance

Objectives: This study compared depressed and nondepressed participants' emotional reactivity to anticipated reward, anticipated punishment, failure to obtain a reward, and successful avoidance of punishment. Experimental design: This study compared residualized change scores on target emotions for currently depressed (n=19), previously depressed (n=19), and never‐depressed (n=43) participants during four experimental conditions: anticipated reward (cash), anticipated punishment (cold pressor), nonreward (failure to earn cash), and avoidance (successful avoidance of a cold pressor). Principal observations: Currently depressed participants' reactivity in response to anticipated reward was significantly diminished compared with never depressed participants', and marginally diminished compared with previously depressed participants'. Currently depressed, previously depressed, and never‐depressed participants did not differ significantly in their emotional reactivity to anticipated punishment or to nonreward or avoidance. Conclusions: These results suggest that depressed individuals' diminished emotional reactivity may be mainly a state effect and may be limited to anticipated reward. Depression and Anxiety, 2009. © 2008 Wiley‐Liss, Inc.     

Trait behavioral approach sensitivity (BAS) relates to early (<150 ms) electrocortical responses to appetitive stimuli

Much past research has focused on how traits related to the behavioral inhibition system (BIS) and avoidance motivation influence the almost obligatory attentional processing of aversive stimuli as measured as early as 100 ms into stimulus processing. These results fit with the functional importance assigned to the negativity bias. But do traits related to the behavioral approach system (BAS) influence attentional processing with similar rapidity? The present study addressed this unanswered question by testing whether trait BAS relates to event-related potentials (ERP) involved in rapid motivated attentional processing to appetitive stimuli. Results indicated that individual differences in BAS were correlated with larger ERP amplitudes as early as 100 ms into the processing of appetitive pictures. These results provide the first evidence linking trait approach motivational tendencies to very early stages of motivated attentional processing.     

Development of behavioral preferences for the optimal choice following unexpected reward omission is mediated by a reduction of D2‐like receptor tone in the nucleus accumbens

To survive in a dynamic environment, animals must identify changes in resource availability and rapidly apply adaptive strategies to obtain resources that promote survival. We have utilised a behavioral paradigm to assess differences in foraging strategy when resource (reward) availability unexpectedly changes. When reward magnitude was reduced by 50% (receive one reward pellet instead of two), male and female rats developed a preference for the optimal choice by the second session. However, when an expected reward was omitted (receive no reward pellets instead of one), subjects displayed a robust preference for the optimal choice during the very first session. Previous research shows that, when an expected reward is omitted, dopamine neurons phasically decrease their firing rate, which is hypothesised to decrease dopamine release preferentially affecting D2‐like receptors. As robust changes in behavioral preference were specific to reward omission, we tested this hypothesis and the functional role of D1‐ and D2‐like receptors in the nucleus accumbens in mediating the rapid development of a behavioral preference for the rewarded option during reward omission in male rats. Blockade of both receptor types had no effect on this behavior; however, holding D2‐like, but not D1‐like, receptor tone via infusion of dopamine receptor agonists prevented the development of the preference for the rewarded option during reward omission. These results demonstrate that avoiding an outcome that has been tagged with aversive motivational properties is facilitated through decreased dopamine transmission and subsequent functional disruption of D2‐like, but not D1‐like, receptor tone in the nucleus accumbens.     

THC reduces the anticipatory nucleus accumbens response to reward in subjects with a nicotine addiction

Recent evidence has implicated the endocannabinoid (eCB) system in nicotine addiction. The eCB system also has an important role in reward mechanisms, and nicotine addiction has been associated with aberrant reward processing. Motivated by this evidence, we tested the hypothesis that eCB modulation of reward processing is altered in subjects with a nicotine addiction (NAD). For this purpose, we compared reward-related activity in NAD with healthy controls (HC) in a pharmacological magnetic resonance imaging (MRI) study using Δ⁹-tetrahydrocannabinol (THC) administration to challenge the eCB system. Eleven HC and 10 NAD participated in a 3-T functional MRI (fMRI) study with a double-blind, cross-over, placebo-controlled design, using a Monetary Incentive Delay (MID) paradigm with three reward levels. Reward activity in the nucleus accumbens (NAcc) and caudate putamen during anticipation and feedback of reward was compared after THC and placebo. fMRI results indicated a significant reduction of reward anticipation activity in the NAcc in NAD after THC administration, which was not present in HC. This is indicated by a significant group by drug by reward interaction. Our data show that THC significantly reduces the NAcc response to monetary reward anticipation in NAD. These results suggest that nicotine addiction is associated with altered eCB modulation of reward processing in the NAcc. This study adds important human data to existing evidence implicating the eCB system in nicotine addiction.     

Arginine vasopressin and adrenocorticotropin secretion in response to psychosocial stress is attenuated by ethanol in sons of alcohol-dependent fathers

Familial risk and environmental stress promote the development of alcohol dependence. We investigated whether a positive family history of alcoholism affects the neuroendocrine response to a standardized laboratory stress test in healthy subjects without alcohol use disorders. Twenty-four high-risk subjects with a paternal history of alcoholism (PHA) and 16 family history negative (FHN) controls were evaluated. Psychosocial stress was induced by having subjects deliver a 5-min speech and mental arithmetics in front of an audience on separate days, after drinking either placebo or ethanol (0.6 g/kg) in a randomized sequence. Adrenocorticotropin (ACTH) was measured in 10 plasma samples covering up to 75 min after the stress test. Plasma arginine vasopressin (AVP) was determined before the stressor, at the time of maximum ACTH secretion, and at 75 min after stress onset. The stress test induced a phasic increase in ACTH secretion. At the time of maximum ACTH, AVP was significantly increased in relation to baseline. Compared to placebo, alcohol administration significantly attenuated maximum ACTH concentration in PHA but not FHN subjects, and decreased AVP measured in the same samples in PHA but not FHN subjects. We conclude that activation of the hypothalamic-pituitary-adrenal system by psychosocial stress is accompanied by an increase in peripheral plasma AVP levels. Secretion of both ACTH and AVP suggest that alcohol attenuates the stress response selectively in PHA but not FHN subjects. This might imply some short-term positive alcohol effect in sons of alcoholics, but also constitute a mechanism by which their risk to develop alcohol use disorders is increased.