Co-operation with another player in a financially rewarded guessing game activates regions implicated in theory of mind

Functional imaging studies have identified a network of brain regions associated with theory of mind (ToM); the attribution of mental states to other people. Similar regions have also been observed in studies where people play games that involve either competing or co-operating with another person. Such games are thought to place implicit demands on ToM processes. Co-operation with others has also been shown to elicit brain responses in areas associated with the processing of reward, suggesting that co-operation is an intrinsically rewarding process. In this study, we used a factorial design to assess the interaction between co-operation and the availability of financial rewards in a guessing game. Twelve subjects were scanned with functional magnetic resonance imaging (fMRI) while they performed a guessing game with and without co-operation, and under both these conditions with and without financial reward. The main effect of co-operation was associated with neural responses in theory of mind regions, while the main effect of financial reward was associated with neural responses in reward regions. Critically the response to reward in medial orbitofrontal cortex was significantly enhanced when subjects were co-operating. This suggests that rewards achieved through co-operation are more valuable than rewards achieved alone.     

Medial orbitofrontal cortex codes relative rather than absolute value of financial rewards in humans

Functional imaging studies in recent years have confirmed the involvement of orbitofrontal cortex (OFC) in human reward processing and have suggested that OFC responses are context-dependent. A seminal electrophysiological experiment in primates taught animals to associate abstract visual stimuli with differently valuable food rewards. Subsequently, pairs of these learned abstract stimuli were presented and firing of OFC neurons to the medium-value stimulus was measured. OFC firing was shown to depend on the relative value context. In this study, we developed a human analogue of this paradigm and scanned subjects using functional magnetic resonance imaging. The analysis compared neuronal responses to two superficially identical events, which differed only in terms of the preceding context. Medial OFC response to the same perceptual stimulus was greater when the stimulus predicted the more valuable of two rewards than when it predicted the less valuable. Additional responses were observed in other components of reward circuitry, the amygdala and ventral striatum. The central finding is consistent with the primate results and suggests that OFC neurons code relative rather than absolute reward value. Amygdala and striatal involvement in coding reward value is also consistent with recent functional imaging data. By using a simpler and less confounded paradigm than many functional imaging studies, we are able to demonstrate that relative financial reward value per se is coded in distinct subregions of an extended reward and decision-making network.     

Variation in TREK1 gene linked to depression‐resistant phenotype is associated with potentiated neural responses to rewards in humans

The TREK1 gene has been linked to a depression‐resistant phenotype in rodents and antidepressant response in humans, but the neural mechanisms underlying these links are unclear. Because TREK1 is expressed in reward‐related basal ganglia regions, it has been hypothesized that TREK1 genetic variation may be associated with anhedonic symptoms of depression. To investigate whether TREK1 genetic variation influences reward processing, we genotyped healthy individuals (n = 31) who completed a monetary incentive delay task during functional magnetic resonance imaging (fMRI). Three genotypes previously linked to positive antidepressant response were associated with potentiated basal ganglia activity to gains, but did not influence responses to penalties or no change feedback. TREK1 genetic variations did not affect basal ganglia volume, and fMRI group differences were confirmed when accounting for self‐report measures of anhedonia. In addition, the total number of “protective” TREK1 alleles was associated with stronger responses to gains in several other reward‐related regions, including the dorsal anterior cingulate cortex, orbitofrontal cortex, and mesial prefrontal cortex. In control analyses, associations between basal ganglia responses to gains and functional polymorphisms in the dopamine transporter (DAT1) and catechol‐O‐methyltransferase (COMT) genes were also explored. Results revealed that TREK1 and DAT/COMT genotypes were independently related to basal ganglia responses to gains. These findings indicate that TREK1 genotypes are associated with individual differences in reward‐related brain activity. Future studies in depressed samples should evaluate whether variation in neural responses to rewards may contribute to the association between TREK1 and antidepressant response in humans. Hum Brain Mapp, 2010. © 2009 Wiley‐Liss, Inc.     

Altered neural reward and loss processing and prediction error signalling in depression

Dysfunctional processing of reward and punishment may play an important role in depression. However, functional magnetic resonance imaging (fMRI) studies have shown heterogeneous results for reward processing in fronto-striatal regions. We examined neural responsivity associated with the processing of reward and loss during anticipation and receipt of incentives and related prediction error (PE) signalling in depressed individuals. Thirty medication-free depressed persons and 28 healthy controls performed an fMRI reward paradigm. Regions of interest analyses focused on neural responses during anticipation and receipt of gains and losses and related PE-signals. Additionally, we assessed the relationship between neural responsivity during gain/loss processing and hedonic capacity. When compared with healthy controls, depressed individuals showed reduced fronto-striatal activity during anticipation of gains and losses. The groups did not significantly differ in response to reward and loss outcomes. In depressed individuals, activity increases in the orbitofrontal cortex and nucleus accumbens during reward anticipation were associated with hedonic capacity. Depressed individuals showed an absence of reward-related PEs but encoded loss-related PEs in the ventral striatum. Depression seems to be linked to blunted responsivity in fronto-striatal regions associated with limited motivational responses for rewards and losses. Alterations in PE encoding might mirror blunted reward- and enhanced loss-related associative learning in depression.     

Individual differences in sensitivity to reward and punishment and neural activity during reward and avoidance learning

In this functional neuroimaging study, we investigated neural activations during the process of learning to gain monetary rewards and to avoid monetary loss, and how these activations are modulated by individual differences in reward and punishment sensitivity. Healthy young volunteers performed a reinforcement learning task where they chose one of two fractal stimuli associated with monetary gain (reward trials) or avoidance of monetary loss (avoidance trials). Trait sensitivity to reward and punishment was assessed using the behavioral inhibition/activation scales (BIS/BAS). Functional neuroimaging results showed activation of the striatum during the anticipation and reception periods of reward trials. During avoidance trials, activation of the dorsal striatum and prefrontal regions was found. As expected, individual differences in reward sensitivity were positively associated with activation in the left and right ventral striatum during reward reception. Individual differences in sensitivity to punishment were negatively associated with activation in the left dorsal striatum during avoidance anticipation and also with activation in the right lateral orbitofrontal cortex during receiving monetary loss. These results suggest that learning to attain reward and learning to avoid loss are dependent on separable sets of neural regions whose activity is modulated by trait sensitivity to reward or punishment.     

Ventral striatal activity links adversity and reward processing in children

Adversity impacts many aspects of psychological and physical development including reward-based learning and decision-making. Mechanisms relating adversity and reward processing in children, however, remain unclear. Here, we show that adversity is associated with potentiated learning from positive outcomes and impulsive decision-making, but unrelated to learning from negative outcomes. We then show via functional magnetic resonance imaging that the link between adversity and reward processing is partially mediated by differences in ventral striatal response to rewards. The findings suggest that early-life adversity is associated with alterations in the brain’s sensitivity to rewards accounting, in part, for the link between adversity and altered reward processing in children.     

A common currency for the computation of motivational values in the human striatum

Reward comparison in the brain is thought to be achieved through the use of a ‘common currency’, implying that reward value representations are computed on a unique scale in the same brain regions regardless of the reward type. Although such a mechanism has been identified in the ventro-medial prefrontal cortex and ventral striatum in the context of decision-making, it is less clear whether it similarly applies to non-choice situations. To answer this question, we scanned 38 participants with fMRI while they were presented with single cues predicting either monetary or erotic rewards, without the need to make a decision. The ventral striatum was the main brain structure to respond to both cues while showing increasing activity with increasing expected reward intensity. Most importantly, the relative response of the striatum to monetary vs erotic cues was correlated with the relative motivational value of these rewards as inferred from reaction times. Similar correlations were observed in a fronto-parietal network known to be involved in attentional focus and motor readiness. Together, our results suggest that striatal reward value signals not only obey to a common currency mechanism in the absence of choice but may also serve as an input to adjust motivated behaviour accordingly.     

Disambiguating ventral striatum fMRI-related BOLD signal during reward prediction in schizophrenia

Reward detection, surprise detection and prediction-error signaling have all been proposed as roles for the ventral striatum (vStr). Previous neuroimaging studies of striatal function in schizophrenia have found attenuated neural responses to reward-related prediction errors; however, as prediction errors represent a discrepancy in mesolimbic neural activity between expected and actual events, it is critical to examine responses to both expected and unexpected rewards (URs) in conjunction with expected and UR omissions in order to clarify the nature of ventral striatal dysfunction in schizophrenia. In the present study, healthy adults and people with schizophrenia were tested with a reward-related prediction-error task during functional magnetic resonance imaging to determine whether schizophrenia is associated with altered neural responses in the vStr to rewards, surprise prediction errors or all three factors. In healthy adults, we found neural responses in the vStr were correlated more specifically with prediction errors than to surprising events or reward stimuli alone. People with schizophrenia did not display the normal differential activation between expected and URs, which was partially due to exaggerated ventral striatal responses to expected rewards (right vStr) but also included blunted responses to unexpected outcomes (left vStr). This finding shows that neural responses, which typically are elicited by surprise, can also occur to well-predicted events in schizophrenia and identifies aberrant activity in the vStr as a key node of dysfunction in the neural circuitry used to differentiate expected and unexpected feedback in schizophrenia.     

Distinct neural responses to conscious versus unconscious monetary reward cues

Human reward pursuit is often assumed to involve conscious processing of reward information. However, recent research revealed that reward cues enhance cognitive performance even when perceived without awareness. Building on this discovery, the present functional MRI study tested two hypotheses using a rewarded mental‐rotation task. First, we examined whether subliminal rewards engage the ventral striatum (VS), an area implicated in reward anticipation. Second, we examined differences in neural responses to supraliminal versus subliminal rewards. Results indicated that supraliminal, but not subliminal, high‐value reward cues engaged brain areas involved in reward processing (VS) and task performance (supplementary motor area, motor cortex, and superior temporal gyrus). This pattern of findings is striking given that subliminal rewards improved performance to the same extent as supraliminal rewards. So, the neural substrates of conscious versus unconscious reward pursuit are vastly different—but despite their differences, conscious and unconscious reward pursuit may still produce the same behavioral outcomes. Hum Brain Mapp 35:5578–5586, 2014. © 2014 Wiley Periodicals, Inc .     

Mesolimbic recruitment by nondrug rewards in detoxified alcoholics: effort anticipation, reward anticipation, and reward delivery

Aberrant sensitivity of incentive neurocircuitry to nondrug rewards has been suggested as either a risk factor for or consequence of drug addiction. Using functional magnetic resonance imaging, we tested whether alcohol‐dependent patients (ADP: n = 29) showed altered recruitment of ventral striatal (VS) incentive neurocircuitry compared to controls (n = 23) by: (1) cues to respond for monetary rewards, (2) post‐response anticipation of rewards, or (3) delivery of rewards. Using an instrumental task with two‐stage presentation of reward‐predictive information, subjects saw cues signaling opportunities to win Aberrant sensitivity of incentive neurocircuitry to nondrug rewards has been suggested as either a risk factor for or consequence of drug addiction. Using functional magnetic resonance imaging, we tested whether alcohol‐dependent patients (ADP: n = 29) showed altered recruitment of ventral striatal (VS) incentive neurocircuitry compared to controls (n = 23) by: (1) cues to respond for monetary rewards, (2) post‐response anticipation of rewards, or (3) delivery of rewards. Using an instrumental task with two‐stage presentation of reward‐predictive information, subjects saw cues signaling opportunities to win Aberrant sensitivity of incentive neurocircuitry to nondrug rewards has been suggested as either a risk factor for or consequence of drug addiction. Using functional magnetic resonance imaging, we tested whether alcohol-dependent patients (ADP: n = 29) showed altered recruitment of ventral striatal (VS) incentive neurocircuitry compared to controls (n = 23) by: (1) cues to respond for monetary rewards, (2) post-response anticipation of rewards, or (3) delivery of rewards. Using an instrumental task with two-stage presentation of reward-predictive information, subjects saw cues signaling opportunities to win $0, $1, or $10 for responding to a target. Following this response, subjects were notified whether their success would be indicated by a lexical notification (“Hit?”) or by delivery of a monetary reward (“Win?”). After a variable interval, subjects then viewed the trial outcome. We found no significant group differences in voxelwise activation by task contrasts, or in signal change extracted from VS. Both ADP and controls showed significant VS and other limbic recruitment by pre-response reward anticipation. In addition, controls also showed VS recruitment by post-response reward-anticipation, and ADP had appreciable subthreshold VS activation. Both groups also showed similar mesolimbic responses to reward deliveries. Across all subjects, a questionnaire measure of “hot” impulsivity correlated with VS recruitment by post-response anticipation of low rewards and with VS recruitment by delivery of low rewards. These findings indicate that incentive-motivational processing of nondrug rewards is substantially maintained in recovering alcoholics, and that reward-elicited VS recruitment correlates more with individual differences in trait impulsivity irrespective of addiction.     

The neural substrates of reward processing in humans: the modern role of FMRI.

Experimental work in animals has identified numerous neural structures involved in reward processing and reward-dependent learning. Until recently, this work provided the primary basis for speculations about the neural substrates of human reward processing. The widespread use of neuroimaging technology has changed this situation dramatically over the past decade through the use of PET and fMRI. Here, the authors focus on the role played by fMRI studies, where recent work has replicated the animal results in human subjects and has extended the view of putative reward-processing neural structures. In particular, fMRI work has identified a set of reward-related brain structures including the orbitofrontal cortex, amygdala, ventral striatum, and medial prefrontal cortex. Moreover, the human experiments have probed the dependence of human reward responses on learned expectations, context, timing, and the reward dimension. Current experiments aim to assess the function of human reward-processing structures to determine how they allow us to predict, assess, and act in response to rewards. The authors review current accomplishments in the study of human reward processing and focus their discussion on explanations directed particularly at the role played by the ventral striatum. They discuss how these findings may contribute to a better understanding of deficits associated with Parkinson's disease.     

Developmental effects of decision-making on sensitivity to reward: An fMRI study

Studies comparing neural correlates of reward processing across development yield inconsistent findings. This challenges theories characterizing adolescents as globally hypo- or hypersensitive to rewards. Developmental differences in reward sensitivity may fluctuate based on reward magnitude, and on whether rewards require decision-making. We examined whether these factors modulate developmental differences in neural response during reward anticipation and/or receipt in 26 adolescents (14.05±2.37yrs) and 26 adults (31.25±8.23yrs). Brain activity was assessed with fMRI during reward anticipation, when subjects made responses with-vs.-without decision-making, to obtain large-vs.-small rewards, and during reward receipt. When reward-receipt required decision-making, neural activity did not differ by age. However, when reward receipt did not require decision-making, neural activity varied by development, reward magnitude, and stage of the reward task. During anticipation, adolescents, but not adults, exhibited greater activity in the insula, extending into putamen, and cingulate gyrus for large-vs.-small incentives. During feedback, adults, but not adolescents, exhibited greater activity in the precuneus for large-vs.-small incentives. These data indicate that age-related differences in reward sensitivity cannot be characterized by global hypo- or hyper-responsivity. Instead, neural responding in striatum, prefrontal cortex and precuneus is influenced by both situational demands and developmental factors. This suggests nuanced maturational effects in adolescent reward sensitivity.     

Contextual interaction between novelty and reward processing within the mesolimbic system

Medial temporal lobe (MTL) dependent long-term memory for novel events is modulated by a circuitry that also responds to reward and includes the ventral striatum, dopaminergic midbrain, and medial orbitofrontal cortex (mOFC). This common neural network may reflect a functional link between novelty and reward whereby novelty motivates exploration in the search for rewards; a link also termed novelty "exploration bonus." We used fMRI in a scene encoding paradigm to investigate the interaction between novelty and reward with a focus on neural signals akin to an exploration bonus. As expected, reward related long-term memory for the scenes (after 24 hours) strongly correlated with activity of MTL, ventral striatum, and substantia nigra/ventral tegmental area (SN/VTA). Furthermore, the hippocampus showed a main effect of novelty, the striatum showed a main effect of reward, and the mOFC signalled both novelty and reward. An interaction between novelty and reward akin to an exploration bonus was found in the hippocampus. These data suggest that MTL novelty signals are interpreted in terms of their reward-predicting properties in the mOFC, which biases striatal reward responses. The striatum together with the SN/VTA then regulates MTL-dependent long-term memory formation and contextual exploration bonus signals in the hippocampus.     

Contextual novelty modulates the neural dynamics of reward anticipation

We investigated how rapidly the reward-predicting properties of visual cues are signaled in the human brain and the extent these reward prediction signals are contextually modifiable. In a magnetoencephalography study, we presented participants with fractal visual cues that predicted monetary rewards with different probabilities. These cues were presented in the temporal context of a preceding novel or familiar image of a natural scene. Starting at ～100 ms after cue onset, reward probability was signaled in the event-related fields (ERFs) over temporo-occipital sensors and in the power of theta (5-8 Hz) and beta (20-30 Hz) band oscillations over frontal sensors. While theta decreased with reward probability beta power showed the opposite effect. Thus, in humans anticipatory reward responses are generated rapidly, within 100 ms after the onset of reward-predicting cues, which is similar to the timing established in non-human primates. Contextual novelty enhanced the reward anticipation responses in both ERFs and in beta oscillations starting at ～100 ms after cue onset. This very early context effect is compatible with a physiological model that invokes the mediation of a hippocampal-VTA loop according to which novelty modulates neural response properties within the reward circuitry. We conclude that the neural processing of cues that predict future rewards is temporally highly efficient and contextually modifiable.     

Attentional modulation of reward processing in the human brain

Although neural signals of reward anticipation have been studied extensively, the functional relationship between reward and attention has remained unclear: Neural signals implicated in reward processing could either reflect attentional biases towards motivationally salient stimuli, or proceed independently of attentional processes. Here, we sought to disentangle reward and attention‐related neural processes by independently modulating reward value and attentional task demands in a functional magnetic resonance imaging study in healthy human participants. During presentation of a visual reward cue that indicated whether monetary reward could be obtained in a subsequent reaction time task, participants either attended to the reward cue or performed an unrelated attention‐demanding task at two different levels of difficulty. In ventral striatum and ventral tegmental area, neural responses were modulated by reward anticipation irrespective of attentional demands, thus indicating attention‐independent processing of reward cues. By contrast, additive effects of reward and attention were observed in visual cortex. Critically, reward‐related activations in right anterior insula strongly depended on attention to the reward cue. Dynamic causal modelling revealed that the attentional modulation of reward processing in insular cortex was mediated by enhanced effective connectivity from ventral striatum to anterior insula. Our results provide evidence for distinct functional roles of the brain regions involved in the processing of reward‐indicating information: While subcortical structures signal the motivational salience of reward cues even when attention is fully engaged elsewhere, reward‐related responses in anterior insula depend on available attentional resources, likely reflecting the conscious evaluation of sensory information with respect to motivational value. Hum Brain Mapp 35:3036–3051, 2014. © 2013 Wiley Periodicals, Inc.     

Neural correlates of frustration

Psychological considerations suggest that the omission of rewards in humans comprises two effects: first, an allocentric effect triggering learning and behavioural changes potentially processed by dopaminergic neurons according to the prediction error theory; second, an egocentric effect representing the individual's emotional reaction, commonly called frustration. We investigated this second effect in the context of omission of monetary reward with functional magnetic resonance imaging. As expected, the contrast omission relative to receipt of reward led to a decrease in ventral striatal activation consistent with prediction error theory. Increased activation for this contrast was found in areas previously related to emotional pain: the right anterior insula and the right ventral prefrontal cortex. We interpreted this as a neural correlate of the egocentric effect.     

Caudate responses to reward anticipation associated with delay discounting behavior in healthy youth

BackgroundChoices requiring delay of gratification made during adolescence can have significant impact on life trajectory. Willingness to delay gratification can be measured using delay discounting tasks that require a choice between a smaller immediate reward and a larger delayed reward. Individual differences in the subjective value of delayed rewards are associated with risk for development of psychopathology including substance abuse. The neurobiological underpinnings related to these individual differences early in life are not fully understood. Using functional magnetic resonance imaging (fMRI), we tested the hypothesis that individual differences in delay discounting behavior in healthy youth are related to differences in responsiveness to potential reward.MethodNineteen 10–14 year-olds performed a monetary incentive delay task to assess neural sensitivity to potential reward and a questionnaire to measure discounting of future monetary rewards.ResultsLeft ventromedial caudate activation during anticipation of potential reward was negatively correlated with delay discounting behavior. There were no regions where brain responses during notification of reward outcome were associated with discounting behavior.ConclusionsBrain activation during anticipation of potential reward may serve as a marker for individual differences in ability or willingness to delay gratification in healthy youth.     

Ventral striatum activation to prosocial rewards predicts longitudinal declines in adolescent risk taking

Adolescence is a period of intensified emotions and an increase in motivated behaviors and passions. Evidence from developmental neuroscience suggests that this heightened emotionality occurs, in part, due to a peak in functional reactivity to rewarding stimuli, which renders adolescents more oriented toward reward-seeking behaviors. Most prior work has focused on how reward sensitivity may create vulnerabilities, leading to increases in risk taking. Here, we test whether heightened reward sensitivity may potentially be an asset for adolescents when engaged in prosocial activities. Thirty-two adolescents were followed over a one-year period to examine whether ventral striatum activation to prosocial rewards predicts decreases in risk taking over a year. Results show that heightened ventral striatum activation to prosocial stimuli relates to longitudinal declines in risk taking. Therefore, the very same neural region that has conferred vulnerability for adolescent risk taking may also be protective against risk taking.     

Neural processing of food and monetary rewards is modulated by metabolic state

In humans, food is considered a powerful primary reinforcer, whereas money is a secondary reinforcer, as it gains a value through learning experience. Here, we aimed to identify the neural regions supporting the processing of food-related reinforcers, relate it to the neural underpinnings of monetary reinforcers, and explore their modulation by metabolic state (hunger vs satiety). Twenty healthy male participants were tested in two experimental sessions, once hungry and once satiated, using functional magnetic resonance imaging. Participants performed an associative learning task, receiving food or monetary rewards (in the form of images) on separate blocks. Irrespective of incentive type, both food and monetary rewards engaged ventral striatum, medial orbitofrontal cortex and amygdala, regions that have been previously associated with reward processing. Food incentives additionally engaged the opercular part of the inferior frontal gyrus and the insula, collectively known as a primary gustatory cortex. Moreover, in response to negative feedback (here, reward omission), robust activation was observed in anterior insula, supplementary motor area and lateral parts of the prefrontal cortex, including middle and inferior frontal gyrus. Furthermore, the interaction between metabolic state and incentive type resulted in supramarginal gyrus (SMG) activity, among other motor and sensory-related regions. Finally, functional connectivity analysis showed correlation in the hungry state between the SMG and mesolimbic regions, including the hippocampus, midbrain and cingulate areas. Also, the interaction between metabolic state and incentive type revealed coupling between SMG and ventral striatum. Whereas general purpose reward-related regions process incentives of different kinds, the current results suggest that the SMG might play a key role in integrating the information related to current metabolic state and available incentive type.     

Lack of ventral striatal response to positive stimuli in depressed versus normal subjects

OBJECTIVE: Most of the functional neuroimaging studies of depression have focused primarily on the resting state or responses to negatively valenced stimuli. However, depression consists not only of an accentuation of negative affective processing but of an inability to experience pleasure or positive motivation. The authors tested the hypothesis that depressed subjects would show less activation than healthy comparison subjects, in response to positive stimuli, in ventral striatal regions associated with processing of reward and positive stimuli. METHOD: Positive, negative, and neutral words were presented to 10 unmedicated depressed patients and 12 healthy comparison subjects in the context of a 3T functional magnetic resonance imaging (MRI) paradigm. Image processing and analysis were performed using statistical parametric mapping with a mixed-effects model. Significant differences in neural responses were assessed, examining group, condition, and interaction effects of interest within the context of a general linear model. RESULTS: Relative to comparison subjects, depressed patients demonstrated significantly less bilateral ventral striatal activation to positive stimuli, correlating with decreased interest/pleasure in and performance of activities. They also displayed decreased activation to positive stimuli in a dorsomedial frontal region associated with processing of self-related stimuli. Responses of depressed subjects to negative stimuli were consistent with the growing literature on frontolimbic dysfunction in depression. CONCLUSIONS: This finding 1) supports a pathophysiological model of depression that includes reward/motivational pathway dysfunction, 2) suggests a contributing neural substrate of the inability to experience pleasure or engage in rewarding activities, 3) provides greater specification of abnormalities of basal ganglia function in depression, and 4) may help guide treatment approaches.