Striatal dopamine D2 receptor availability predicts the thalamic and medial prefrontal responses to reward in cocaine abusers three years later

Low levels of dopamine (DA) D2 receptor availability at a resting baseline have been previously reported in drug addicted individuals and have been associated with reduced ventral and dorsal prefrontal metabolism. The reduction in DA D2 receptor availability along with the reduced ventral frontal metabolism is thought to underlie compromised sensitivity to nondrug reward, a core characteristic of drug addiction. We therefore hypothesized that variability in DA D2 receptor availability at baseline will covary with dynamic responses to monetary reward in addicted individuals. Striatal DA D2 receptor availability was measured with [¹¹C]raclopride and positron emission tomography and response to monetary reward was measured (an average of three years later) with functional magnetic resonance imaging in seven cocaine‐addicted individuals. Results show that low DA D2 receptor availability in the dorsal striatum was associated with decreased thalamic response to monetary reward; while low availability in ventral striatum was associated with increased medial prefrontal (Brodmann Area 6/8/32) response to monetary reward. These preliminary results, that need to be replicated in larger sample sizes and validated with healthy controls, suggest that resting striatal DA D2 receptor availability predicts variability in functional responses to a nondrug reinforcer (money) in prefrontal cortex, implicated in behavioral monitoring, and in thalamus, implicated in conditioned responses and expectation, in cocaine‐addicted individuals. Synapse 64:397–402, 2010. © 2009 Wiley‐Liss, Inc.     

Individual differences in sensitivity to reward and punishment and neural activity during reward and avoidance learning

In this functional neuroimaging study, we investigated neural activations during the process of learning to gain monetary rewards and to avoid monetary loss, and how these activations are modulated by individual differences in reward and punishment sensitivity. Healthy young volunteers performed a reinforcement learning task where they chose one of two fractal stimuli associated with monetary gain (reward trials) or avoidance of monetary loss (avoidance trials). Trait sensitivity to reward and punishment was assessed using the behavioral inhibition/activation scales (BIS/BAS). Functional neuroimaging results showed activation of the striatum during the anticipation and reception periods of reward trials. During avoidance trials, activation of the dorsal striatum and prefrontal regions was found. As expected, individual differences in reward sensitivity were positively associated with activation in the left and right ventral striatum during reward reception. Individual differences in sensitivity to punishment were negatively associated with activation in the left dorsal striatum during avoidance anticipation and also with activation in the right lateral orbitofrontal cortex during receiving monetary loss. These results suggest that learning to attain reward and learning to avoid loss are dependent on separable sets of neural regions whose activity is modulated by trait sensitivity to reward or punishment.     

Subthalamic Oscillatory Activity of Reward and Loss Processing Using the Monetary Incentive Delay Task in Parkinson Disease

BackgroundThe subthalamic nucleus (STN) is an effective deep brain stimulation target for Parkinson disease (PD) and obsessive-compulsive disorder and has been implicated in reward and motivational processing. In this study, we assessed the STN and prefrontal oscillatory dynamics in the anticipation and receipt of reward and loss using a task commonly used in imaging.Materials and MethodsWe recorded intracranial left subthalamic local field potentials from deep brain stimulation electrodes and prefrontal scalp electroencephalography in 17 patients with PD while they performed a monetary incentive delay task.ResultsDuring the expectation phase, enhanced left STN delta-theta activity was observed in both reward and loss vs neutral anticipation, with greater STN delta-theta activity associated with greater motivation specifically to reward. In the consummatory outcome phase, greater left STN delta activity was associated with a rewarding vs neutral outcome, particularly with more ventral contacts along with greater delta-theta coherence with the prefrontal cortex. We highlight a differential activity in the left STN to loss vs reward anticipation, demonstrating a distinct STN high gamma activity. Patients with addiction-like behaviors show lower left STN delta-theta activity to loss vs neutral outcomes, emphasizing impaired sensitivity to negative outcomes.ConclusionsTogether, our findings highlight a role for the left STN in reward and loss processing and a potential role in addictive behaviors. These findings emphasize the cognitive-limbic function of the STN and its role as a physiologic target for neuropsychiatric disorders.     

Common and distinct neural features of social and non-social reward processing in autism and social anxiety disorder

Autism spectrum disorders (ASDs) and social anxiety disorder (SAD) are both characterized by social dysfunction, but no study to date has compared neural responses to social rewards in ASDs and SAD. Neural responses during social and non-social reward anticipation and outcomes were examined in individuals with ASD (n = 16), SAD (n = 15) and a control group (n = 19) via functional magnetic resonance imaging. Analyses modeling all three groups revealed increased nucleus accumbens (NAc) activation in SAD relative to ASD during monetary reward anticipation, whereas both the SAD and ASD group demonstrated decreased bilateral NAc activation relative to the control group during social reward anticipation. During reward outcomes, the SAD group did not differ significantly from the other two groups in ventromedial prefrontal cortex activation to either reward type. Analyses comparing only the ASD and SAD groups revealed greater bilateral amygdala activation to social rewards in SAD relative to ASD during both anticipation and outcome phases, and the magnitude of left amygdala hyperactivation in the SAD group during social reward anticipation was significantly correlated with the severity of trait anxiety symptoms. Results suggest reward network dysfunction to both monetary and social rewards in SAD and ASD during reward anticipation and outcomes, but that NAc hypoactivation during monetary reward anticipation differentiates ASD from SAD.     

Individual associations of adolescent alcohol use disorder versus cannabis use disorder symptoms in neural prediction error signaling and the response to novelty

Two of the most commonly used illegal substances by adolescents are alcohol and cannabis. Alcohol use disorder (AUD) and cannabis use disorder (CUD) are associated with poorer decision-making in adolescents. In adolescents, level of AUD symptomatology has been negatively associated with striatal reward responsivity. However, little work has explored the relationship with striatal reward prediction error (RPE) representation and the extent to which any augmentation of RPE by novel stimuli is impacted. One-hundred fifty-one adolescents participated in the Novelty Task while undergoing functional magnetic resonance imaging (fMRI). In this task, participants learn to choose novel or non-novel stimuli to gain monetary reward. Level of AUD symptomatology was negatively associated with both optimal decision-making and BOLD response modulation by RPE within striatum and regions of prefrontal cortex. The neural alterations in RPE representation were particularly pronounced when participants were exploring novel stimuli. Level of CUD symptomatology moderated the relationship between novelty propensity and RPE representation within inferior parietal lobule and dorsomedial prefrontal cortex. These data expand on an emerging literature investigating individual associations of AUD symptomatology levels versus CUD symptomatology levels and RPE representation during reinforcement processing and provide insight on the role of neuro-computational processes underlying reinforcement learning/decision-making in adolescents.     

Differential brain activation according to chronic social reward frustration

Neural correlates of reward frustration are increasingly studied in humans. In line with prediction error theory, omission of an expected reward is associated with relative decreases of cerebral activation in dopaminergic brain areas. We investigated whether a history of chronic work-related reward frustration influences this reward-dependent activation pattern by means of functional magnetic resonance imaging. Solving arithmetic tasks was followed by either monetary reward or omission of reward. Hyperactivations in the medial prefrontal, anterior cingulate and dorsolateral prefrontal cortex were observed in a group of healthy adults with high susceptibility to reward frustration as compared with a group with low susceptibility. Findings indicate a compromised ability of adapting brain activation among those suffering form chronic social reward frustration.     

Frontostriatal response to set switching is moderated by reward sensitivity

The reinforcement sensitivity theory (RST) relates individual differences in reward sensitivity to the activation of the behavioral approach system (BAS). Dopamine-related brain structures have been repeatedly associated with reward processing, but also with cognitive processes such as task switching. In the present study, we examined the association between reward sensitivity and the event-related fMRI BOLD response with set switching in 31 males. As expected, the right inferior frontal cortex (rIFG) and the striatum (i.e. the left putamen) were involved in set-switching activity for the overall sample. Interindividual differences in Gray's reward sensitivity were related to stronger activity in the rIFG and the ventral striatum. Thus, trait reward sensitivity contributed to the modulation of brain responsiveness in set-switching tasks. Having considered previous research, we propose that higher BAS activity is associated with a stronger reward to process a better implementation of goal-directed tasks and the diminished processing of secondary cues.     

Altered monetary loss processing and reinforcement-based learning in individuals with obesity

Individuals with obesity are often characterized by alterations in reward processing. This may affect how new information is used to update stimulus values during reinforcement-based learning. Here, we investigated obesity-related changes in non-food reinforcement processing, their impact on learning performance as well as the neural underpinnings of reinforcement-based learning in obesity. Nineteen individuals with obesity (BMI?>?=?30 kg/m², 10 female) and 23 lean control participants (BMI 18.5–24.9 kg/m², 11 female) performed a probabilistic learning task during functional magnetic resonance imaging (fMRI), in which they learned to choose between advantageous and disadvantageous choice options in separate monetary gain, loss, and neutral conditions. During learning individuals with obesity made a significantly lower number of correct choices and accumulated a significantly lower overall monetary outcome than lean control participants. FMRI analyses revealed aberrant medial prefrontal cortex responses to monetary losses in individuals with obesity. There were no significant group differences in the regional representation of prediction errors. However, we found evidence for increased functional connectivity between the ventral striatum and insula in individuals with obesity. The present results suggest that obesity is associated with aberrant value representations for monetary losses, alterations in functional connectivity during the processing of learning outcomes, as well as a decresased reinforcement-based learning performance. This may affect how new information is incorporated to adjust dysfunctional behavior and could be a factor contributing to the maintenance of dysfunctional eating behavior in obesity.     

A common mechanism for adaptive scaling of reward and novelty

Declarative memory is remarkably adaptive in the way it maintains sensitivity to relative novelty in both unknown and highly familiar environments. However, the neural mechanisms underlying this contextual adaptation are poorly understood. On the basis of emerging links between novelty processing and reinforcement learning mechanisms, we hypothesized that responses to novelty will be adaptively scaled according to expected contextual probabilities of new and familiar events, in the same way that responses to prediction errors for rewards are scaled according to their expected range. Using functional magnetic resonance imaging in humans, we show that the influence of novelty and reward on memory formation in an incidental memory task is adaptively scaled and furthermore that the BOLD signal in orbital prefrontal and medial temporal cortices exhibits concomitant scaled adaptive coding. These findings demonstrate a new mechanism for adjusting gain and sensitivity in declarative memory in accordance with contextual probabilities and expectancies of future events. Hum Brain Mapp, 2010. © 2010 Wiley‐Liss, Inc.     

Neuronal correlates and serotonergic modulation of behavioural inhibition and reward in healthy and antisocial individuals

Individuals with antisocial personality disorder (ASPD) are impulsive and show impairment in reinforcement processing. There is increasing evidence for a neurobiological basis of psychopathy, which shares some of the characteristics of ASPD, but research on the neuronal correlates of neuropsychological processes in ASPD remains limited. Furthermore, no research has examined the effects of serotonergic manipulation on brain activations in antisocial groups. In this study, 25 male participants with ASPD (mean age 42.1) and 32 male control participants (mean age 30.5; 25 participants providing usable scans) were randomly allocated to receive the 5-HT_2C-agonist mCPP or placebo. Participants were scanned using functional magnetic resonance imaging (fMRI) during a behavioural inhibition (Go/NoGo) and a reward task. In comparison to healthy controls the ASPD group showed reduced task related activations in the dorsolateral prefrontal cortex (DLPFC) but increased signal in the pre/subgenual anterior cingulate cortex (ACC) in the Go/No-Go task and increased activation in OFC in the reward task. mCPP modulated brain responses in both tasks in the whole group. Interactions between group and drug occured in bilateral OFC, caudate and ventral pallidum during the reward task but no significant interactions were found in the Go/No-Go task. This suggests that ASPD involves altered serotonin modulation of reward, but not motor inhibition pathways. These findings suggest that ASPD involves altered DLPFC, ACC and OFC function. Altered serotonergic modulation of reward pathways seen in the ASPD group raises the possibility that targeting serotonin systems may be therapeutic.     

Neural correlates of reward and loss sensitivity in psychopathy

Psychopathy is a personality disorder associated with callous and impulsive behavior and criminal recidivism. It has long been theorized that psychopaths have deficits in processing reward and punishment. Here, we use structural and functional magnetic resonance imaging to examine the neural correlates of reward and loss sensitivity in a group of criminal psychopaths. Forty-one adult male prison inmates (n = 18 psychopaths and n = 23 non-psychopaths) completed a functional magnetic resonance imaging task involving the gain or loss of money. Across the entire sample of participants, monetary gains elicited robust activation within the ventral striatum (VS). Although psychopaths and non-psychopaths did not significantly differ with respect to overall levels of VS response to reward vs loss, we observed significantly different correlations between VS responses and psychopathy severity within each group. Volumetric analyses of striatal subregions revealed a similar pattern of correlations, specifically for the right accumbens area within VS. In a separate sample of inmates (n = 93 psychopaths and n = 117 non-psychopaths) who completed a self-report measure of appetitive motivation, we again found that the correlation with psychopathy severity differed between groups. These convergent results offer novel insight into the neural substrates of reward and loss processing in psychopathy.     

Reward circuitry function in autism spectrum disorders

Social interaction deficits and restricted repetitive behaviors and interests that characterize autism spectrum disorders (ASDs) may both reflect aberrant functioning of brain reward circuits. However, no neuroimaging study to date has investigated the integrity of reward circuits using an incentive delay paradigm in individuals with ASDs. In the present study, we used functional magnetic resonance imaging to assess blood-oxygen level-dependent activation during reward anticipation and outcomes in 15 participants with an ASD and 16 matched control participants. Brain activation was assessed during anticipation of and in response to monetary incentives and object image incentives previously shown to be visually salient for individuals with ASDs (e.g. trains, electronics). Participants with ASDs showed decreased nucleus accumbens activation during monetary anticipation and outcomes, but not during object anticipation or outcomes. Group × reward-type-interaction tests revealed robust interaction effects in bilateral nucleus accumbens during reward anticipation and in ventromedial prefrontal cortex during reward outcomes, indicating differential responses contingent on reward type in these regions. Results suggest that ASDs are characterized by reward-circuitry hypoactivation in response to monetary incentives but not in response to autism-relevant object images. The clinical implications of the double dissociation of reward type and temporal phase in reward circuitry function in ASD are discussed.     

A double dissociation of ventromedial prefrontal cortical responses to sad and happy stimuli in depressed and healthy individuals.

BACKGROUND: The ventromedial prefrontal cortex (VMPFC) is a region implicated in the assessment of the rewarding potential of stimuli and may be dysfunctional in major depressive disorder (MDD). The few studies examining prefrontal cortical responses to emotive stimuli in MDD have indicated increased VMPFC responses to pleasant images but decreased responses to sad mood provocation when compared with healthy individuals. We wished to corroborate these results by examining neural responses to personally relevant happy and sad stimuli in MDD and healthy individuals within the same paradigm. METHODS: Neural responses to happy and sad emotional stimuli (autobiographical memory prompts and congruent facial expressions) were measured using blood oxygenation level dependent (BOLD) functional magnetic resonance imaging (fMRI) in MDD (n = 12) and healthy (n = 12) individuals. RESULTS: Increased and decreased responses in VMPFC were observed in MDD and healthy individuals, respectively, to happy stimuli, whereas the pattern was reversed for MDD and healthy individual responses to sad stimuli. These findings were not explained by medication effects in depressed individuals. CONCLUSIONS: These findings indicate a double dissociation of the pattern of VMPFC response to happy and sad stimuli in depressed and healthy individuals and suggest abnormal reward processing in MDD.     

Neural evidence for enhanced error detection in major depressive disorder

OBJECTIVE: Anomalies in error processing have been implicated in the etiology and maintenance of major depressive disorder. In particular, depressed individuals exhibit heightened sensitivity to error-related information and negative environmental cues, along with reduced responsivity to positive reinforcers. The authors examined the neural activation associated with error processing in individuals diagnosed with and without major depression and the sensitivity of these processes to modulation by monetary task contingencies. METHOD: The error-related negativity and error-related positivity components of the event-related potential were used to characterize error monitoring in individuals with major depressive disorder and the degree to which these processes are sensitive to modulation by monetary reinforcement. Nondepressed comparison subjects (N=17) and depressed individuals (N=18) performed a flanker task under two external motivation conditions (i.e., monetary reward for correct responses and monetary loss for incorrect responses) and a nonmonetary condition. After each response, accuracy feedback was provided. The error-related negativity component assessed the degree of anomaly in initial error detection, and the error positivity component indexed recognition of errors. RESULTS: Across all conditions, the depressed participants exhibited greater amplitude of the error-related negativity component, relative to the comparison subjects, and equivalent error positivity amplitude. In addition, the two groups showed differential modulation by task incentives in both components. CONCLUSIONS: These data implicate exaggerated early error-detection processes in the etiology and maintenance of major depressive disorder. Such processes may then recruit excessive neural and cognitive resources that manifest as symptoms of depression.     

Adaptive neural reward processing during anticipation and receipt of monetary rewards in mindfulness meditators

Reward seeking is ubiquitous and adaptive in humans. But excessive reward seeking behavior, such as chasing monetary rewards, may lead to diminished subjective well-being. This study examined whether individuals trained in mindfulness meditation show neural evidence of lower susceptibility to monetary rewards. Seventy-eight participants (34 meditators, 44 matched controls) completed the monetary incentive delay task while undergoing functional magnetic resonance imaging. The groups performed equally on the task, but meditators showed lower neural activations in the caudate nucleus during reward anticipation, and elevated bilateral posterior insula activation during reward anticipation. Meditators also evidenced reduced activations in the ventromedial prefrontal cortex during reward receipt compared with controls. Connectivity parameters between the right caudate and bilateral anterior insula were attenuated in meditators during incentive anticipation. In summary, brain regions involved in reward processing—both during reward anticipation and receipt of reward—responded differently in mindfulness meditators than in nonmeditators, indicating that the former are less susceptible to monetary incentives.     

Striatal responses to negative monetary outcomes differ between temperamentally inhibited and non-inhibited adolescents

The present study compared blood oxygen level dependent (BOLD) response in behaviorally inhibited and behaviorally non-inhibited adolescents to positive and negative feedback following their choice in a reward task. Previous data in these same subjects showed enhanced activation in striatal areas in behaviorally inhibited subjects to cues predicting gain or a loss. However, no analyses had examined responses following actual gains or losses. Relative to non-inhibited subjects, behaviorally inhibited subjects in the current study showed enhanced caudate response to negative but not positive feedback, indicating that striatal sensitivity to feedback may be specific to aversive information. In addition, compared to non-inhibited subjects, behaviorally inhibited subjects exhibited reduced differentiation between positive and negative feedback in ventromedial prefrontal cortex (vmPFC). This suggests a perturbed ability to encode reward value.     

A bold view of the lactating brain: functional magnetic resonance imaging studies of suckling in awake dams

Functional magnetic resonance imaging (fMRI) has been used to investigate the responsiveness of the maternal rat brain to pup-suckling under various experimental paradigms. Our research employing the lactating rat model has explored the cortical sensory processing of pup stimuli and the effect of suckling on the brain's reward system. Suckling was observed to increase blood-oxygen-level-dependent (BOLD) signal intensity in the midbrain, striatum and prefrontal cortex, which are areas that receive prominent dopaminergic inputs. The BOLD activation of the reward system occurs in parallel with the activation of extensive cortical sensory areas. The observed regions include the olfactory cortex, auditory cortex and gustatory cortex, and could correspond to cortical representations of pup odours, vocalisations and taste that are active during lactation. Activation patterns within reward regions are consistent with past research on maternal motivation and we explore the possibility that exposure to drugs of abuse might be disruptive of maternal neural responses to pups, particularly in the prefrontal cortex. Our ongoing fMRI studies support and extend past research on the maternal rat brain and its functional neurocircuitry.     

Identifying Cognitive Remediation Change Through Computational Modelling—Effects on Reinforcement Learning in Schizophrenia

Objective: Converging research suggests that individuals with schizophrenia show a marked impairment in reinforcement learning, particularly in tasks requiring flexibility and adaptation. The problem has been associated with dopamine reward systems. This study explores, for the first time, the characteristics of this impairment and how it is affected by a behavioral intervention—cognitive remediation. Method: Using computational modelling, 3 reinforcement learning parameters based on the Wisconsin Card Sorting Test (WCST) trial-by-trial performance were estimated: R (reward sensitivity), P (punishment sensitivity), and D (choice consistency). In Study 1 the parameters were compared between a group of individuals with schizophrenia (n = 100) and a healthy control group (n = 50). In Study 2 the effect of cognitive remediation therapy (CRT) on these parameters was assessed in 2 groups of individuals with schizophrenia, one receiving CRT (n = 37) and the other receiving treatment as usual (TAU, n = 34). Results: In Study 1 individuals with schizophrenia showed impairment in the R and P parameters compared with healthy controls. Study 2 demonstrated that sensitivity to negative feedback (P) and reward (R) improved in the CRT group after therapy compared with the TAU group. R and P parameter change correlated with WCST outputs. Improvements in R and P after CRT were associated with working memory gains and reduction of negative symptoms, respectively. Conclusion: Schizophrenia reinforcement learning difficulties negatively influence performance in shift learning tasks. CRT can improve sensitivity to reward and punishment. Identifying parameters that show change may be useful in experimental medicine studies to identify cognitive domains susceptible to improvement.Key words: reward systems, cognitive remediation, therapy, sensitivity, Wisconsin Card Sorting test, reward sensitivity, dopamine     

Monetary reward magnitude effects on behavior and brain function during goal-directed behavior

Reward may modulate the cognitive processes required for goal achievement, while individual differences in personality may affect reward modulation. Our aim was to test how different monetary reward magnitudes modulate brain activation and performance during goal-directed behavior, and whether individual differences in reward sensitivity affect this modulation. For this purpose, we scanned 37 subjects with a parametric design in which we varied the magnitude of monetary rewards (€0, €0.01, €0.5, €1 or €1.5) in a blocked fashion while participants performed an interference counting-Stroop condition. The results showed that the brain activity of left dorsolateral prefrontal cortex (DLPFC) and the striatum were modulated by increasing and decreasing reward magnitudes, respectively. Behavioral performance improved as the magnitude of monetary reward increased while comparing the non reward (€0) condition to any other reward condition, or the lower €0.01 to any other reward condition, and this improvement was related with individual differences in reward sensitivity. In conclusion, the locus of influence of monetary incentives overlaps the activity of the regions commonly involved in cognitive control.     

Novelty seeking modulates medial prefrontal activity during the anticipation of emotional stimuli

In a functional magnetic resonance imaging experiment, expectancy cues signaling emotional stimuli were used to study the personality trait of novelty seeking. BOLD responses to emotional expectancy were positively correlated with novelty-seeking scores in the medial prefrontal cortex. This correlation was strongest for the sub-dimension of exploratory excitability.