Risky decision making and the anterior cingulate cortex in abstinent drug abusers and nonusers

Risky decision making is a hallmark behavioral phenotype of drug abuse; thus, an understanding of its biological bases may inform efforts to develop therapies for addictive disorders. A neurocognitive task that measures this function (Rogers Decision-Making Task; RDMT) was paired with measures of regional cerebral perfusion to identify brain regions that may underlie deficits in risky decision making in drug abusers. Subjects were abstinent drug abusers (> or =3 months) and healthy controls who underwent positron emission tomography scans with H(2)(15)O. Drug abusers showed greater risk taking and heightened sensitivity to rewards than control subjects. Both drug abusers and controls exhibited significant activations in a widespread network of brain regions, primarily in the frontal cortex, previously implicated in decision-making tasks. The only significant group difference in brain activation, however, was found in the left pregenual anterior cingulate cortex, with drug abusers exhibiting less task-related activation than control subjects. There were no significant correlations between neural activity and task performance within the control group. In the drug abuse group, on the other hand, increased risky choices on the RDMT negatively correlated with activation in the right hippocampus, left anterior cingulate gyrus, left medial orbitofrontal cortex, and left parietal lobule, and positively correlated with activation in the right insula. Drug abuse severity was related positively to right medial orbitofrontal activity. Attenuated activation of the pregenual ACC in the drug abusers relative to the controls during performance on the RDMT may underlie the abusers' tendency to choose risky outcomes.     

Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables

Damage to the frontal lobe can cause severe decision-making impairments. A mechanism that may underlie this is that neurons in the frontal cortex encode many variables that contribute to the valuation of a choice, such as its costs, benefits and probability of success. However, optimal decision-making requires that one considers these variables, not only when faced with the choice, but also when evaluating the outcome of the choice, in order to adapt future behaviour appropriately. To examine the role of the frontal cortex in encoding the value of different choice outcomes, we simultaneously recorded the activity of multiple single neurons in the anterior cingulate cortex (ACC), orbitofrontal cortex (OFC) and lateral prefrontal cortex (LPFC) while subjects evaluated the outcome of choices involving manipulations of probability, payoff and cost. Frontal neurons encoded many of the parameters that enabled the calculation of the value of these variables, including the onset and offset of reward and the amount of work performed, and often encoded the value of outcomes across multiple decision variables. In addition, many neurons encoded both the predicted outcome during the choice phase of the task as well as the experienced outcome in the outcome phase of the task. These patterns of selectivity were more prevalent in ACC relative to OFC and LPFC. These results support a role for the frontal cortex, principally ACC, in selecting between choice alternatives and evaluating the outcome of that selection thereby ensuring that choices are optimal and adaptive.     

Distinct roles of three frontal cortical areas in reward-guided behavior

Functional magnetic resonance imaging was used to measure activity in three frontal cortical areas, the lateral orbitofrontal cortex (lOFC), medial orbitofrontal cortex (mOFC)/ventromedial frontal cortex (vmPFC), and anterior cingulate cortex (ACC), when expectations about type of reward, and not just reward presence or absence, could be learned. Two groups of human subjects learned 12 stimulus-response pairings. In one group (Consistent), correct performances of a given pairing were always reinforced with a specific reward outcome, whereas in the other group (Inconsistent), correct performances were reinforced with randomly selected rewards. The mOFC/vmPFC and lOFC were not distinguished by simple differences in relative preference for positive and negative outcomes. Instead lOFC activity reflected updating of reward-related associations specific to reward type; lOFC was active whenever informative outcomes allowed updating of reward-related associations, regardless of whether the outcomes were positive or negative, and the effects were greater when consistent stimulus-outcome and response-outcome mappings were present. A psychophysiological interaction analysis demonstrated changed coupling between lOFC and brain areas for visual object representation, such as perirhinal cortex, and reward-guided learning, such as the amygdala, ventral striatum, and habenula/mediodorsal thalamus. In contrast, mOFC/vmPFC activity reflected expected values of outcomes and occurrence of positive outcomes, regardless of consistency of outcome mappings. The third frontal cortical region, the ACC, reflected the use of reward type information to guide response selection. ACC activity reflected the probability of selecting the correct response, was greater when consistent outcome mappings were present, and was related to individual differences in propensity to select the correct response.     

Neuronal activity of the anterior cingulate cortex during an observation-based decision making task in monkeys

The medial prefrontal cortex (mPFC) including the anterior cingulate sulcus is implicated in both decision-making and social cognition, suggesting that this area may play a central role in decision-making based on social context. In the present study, neural activity was recorded from the monkey anterior cingulate cortex (ACC) while the monkeys chose one of two identical figures based on the choice previously made by a robot arm. Monkeys observed that the robot touched one of the two figures in the left or right side of a touch screen. Every time the robot chose the correct option, the same pair appeared on another touch screen for the monkey. Then, the monkey had to touch the figure in the same side to obtain reward. Neuronal responses were compared by one-way ANOVA among 17 intervals distributed in 4 phases: baseline before the trial, observation phase (robot arm choices and feedback signals), inter-phase interval (between observation and following execution phases), and execution phase (monkeys choices and associated outcomes). Of 264 neurons recorded, 164 (62.12%) responded in one or more intervals of the task. Of these, 16 responded during the observation-phase, 5 during the inter-phase interval, 98 during the execution-phase and 18 on both observation and execution phases. Furthermore, neuronal activity of 69 (26.14%) neurons during action observation was correlated with that during real action (execution). This type of neurons might correspond to mirror neurons. The results indicated that the ACC processes information about self and others actions and outcomes, which may support social-based decision-making.     

Common and distinct networks underlying reward valence and processing stages: a meta-analysis of functional neuroimaging studies

To better understand the reward circuitry in human brain, we conducted activation likelihood estimation (ALE) and parametric voxel-based meta-analyses (PVM) on 142 neuroimaging studies that examined brain activation in reward-related tasks in healthy adults. We observed several core brain areas that participated in reward-related decision making, including the nucleus accumbens (NAcc), caudate, putamen, thalamus, orbitofrontal cortex (OFC), bilateral anterior insula, anterior cingulate cortex (ACC) and posterior cingulate cortex (PCC), as well as cognitive control regions in the inferior parietal lobule and prefrontal cortex (PFC). The NAcc was commonly activated by both positive and negative rewards across various stages of reward processing (e.g., anticipation, outcome, and evaluation). In addition, the medial OFC and PCC preferentially responded to positive rewards, whereas the ACC, bilateral anterior insula, and lateral PFC selectively responded to negative rewards. Reward anticipation activated the ACC, bilateral anterior insula, and brain stem, whereas reward outcome more significantly activated the NAcc, medial OFC, and amygdala. Neurobiological theories of reward-related decision making should therefore take distributed and interrelated representations of reward valuation and valence assessment into account.     

Event-related functional magnetic resonance imaging of reward-related brain circuitry in children and adolescents.

BACKGROUND: Functional disturbances in reward-related brain systems are thought to play a role in the development of mood, impulse, and substance-abuse disorders. Studies in nonhuman primates have identified brain regions, including the dorsal/ventral striatum and orbital-frontal cortex, in which neural activity is modulated by reward. Recent studies in adults have concurred with these findings by observing reward-contingent blood oxygen level-dependent (BOLD) responses in these regions during functional magnetic resonance imaging (fMRI) paradigms; however, no previous studies indicate whether comparable modulations of neural activity exist in the brain reward systems of children and adolescents. METHODS: We used event-related fMRI and a behavioral paradigm modeled on previous work in adults to study brain responses to monetary gains and losses in psychiatrically healthy children and adolescents as part of a program examining the neural substrates of anxiety and depression in youth. RESULTS: Regions and time-courses of reward-related activity were similar to those observed in adults with condition-dependent BOLD changes in the ventral striatum and lateral and medial orbital-frontal cortex; specifically, these regions showed larger responses to positive than to negative feedback. CONCLUSIONS: These results provide further evidence for the value of event-related fMRI in examining reward systems of the brain, demonstrate the feasibility of this approach in children and adolescents, and establish a baseline from which to understand the pathophysiology of reward-related psychiatric disorders in youth.     

Enhanced affective brain representations of chocolate in cravers vs. non-cravers

To examine the neural circuitry involved in food craving, in making food particularly appetitive and thus in driving wanting and eating, we used fMRI to measure the response to the flavour of chocolate, the sight of chocolate and their combination in cravers vs. non-cravers. Statistical parametric mapping (SPM) analyses showed that the sight of chocolate produced more activation in chocolate cravers than non-cravers in the medial orbitofrontal cortex and ventral striatum. For cravers vs. non-cravers, a combination of a picture of chocolate with chocolate in the mouth produced a greater effect than the sum of the components (i.e. supralinearity) in the medial orbitofrontal cortex and pregenual cingulate cortex. Furthermore, the pleasantness ratings of the chocolate and chocolate-related stimuli had higher positive correlations with the fMRI blood oxygenation level-dependent signals in the pregenual cingulate cortex and medial orbitofrontal cortex in the cravers than in the non-cravers. To our knowledge, this is the first study to show that there are differences between cravers and non-cravers in their responses to the sensory components of a craved food in the orbitofrontal cortex, ventral striatum and pregenual cingulate cortex, and that in some of these regions the differences are related to the subjective pleasantness of the craved foods. Understanding individual differences in brain responses to very pleasant foods helps in the understanding of the mechanisms that drive the liking for specific foods and thus intake of those foods.     

The influence of emotion regulation on decision-making under risk

Cognitive strategies typically involved in regulating negative emotions have recently been shown to also be effective with positive emotions associated with monetary rewards. However, it is less clear how these strategies influence behavior, such as preferences expressed during decision-making under risk, and the underlying neural circuitry. That is, can the effective use of emotion regulation strategies during presentation of a reward-conditioned stimulus influence decision-making under risk and neural structures involved in reward processing such as the striatum? To investigate this question, we asked participants to engage in imagery-focused regulation strategies during the presentation of a cue that preceded a financial decision-making phase. During the decision phase, participants then made a choice between a risky and a safe monetary lottery. Participants who successfully used cognitive regulation, as assessed by subjective ratings about perceived success and facility in implementation of strategies, made fewer risky choices in comparison with trials where decisions were made in the absence of cognitive regulation. Additionally, BOLD responses in the striatum were attenuated during decision-making as a function of successful emotion regulation. These findings suggest that exerting cognitive control over emotional responses can modulate neural responses associated with reward processing (e.g., striatum) and promote more goal-directed decision-making (e.g., less risky choices), illustrating the potential importance of cognitive strategies in curbing risk-seeking behaviors before they become maladaptive (e.g., substance abuse).     

Dissociation of BOLD responses to reward prediction errors and reward receipt by a model comparison

The representation of reward anticipation and reward prediction errors is the basis for reward-associated learning. The representation of whether or not a reward occurred (reward receipt) is important for decision making. Recent studies suggest that, while reward anticipation and reward prediction errors are encoded in the midbrain and the ventral striatum, reward receipts are encoded in the medial orbitofrontal cortex. In order to substantiate this functional specialization we analyzed data from an fMRI study in which 59 subjects completed two simple monetary reward paradigms. Because reward receipts and reward prediction errors were correlated, a statistical model comparison was applied separating the effects of the two. Reward prediction error fitted BOLD responses significantly better than reward receipt in the midbrain and the ventral striatum. Conversely, reward receipt fitted BOLD responses better in the orbitofrontal cortex. Activation related to reward anticipation was found in the orbitofrontal cortex. The results confirm a functional specialization of behaviorally important aspects of reward processing within the mesolimbic dopaminergic system.     

The affective and cognitive processing of touch, oral texture, and temperature in the brain

Some of the principles of the representation of affective touch in the brain are described. Positively affective touch and temperature are represented in parts of the orbitofrontal and pregenual cingulate cortex. The orbitofrontal cortex is implicated in some of the affective aspects of touch that may be mediated through C fibre touch afferents, in that it is activated more by light touch to the forearm (a source of C-tactile (CT) afferents) than by light touch to the glabrous skin of the hand. Oral somatosensory afferents implicated in sensing the texture of food including fat in the mouth also activate the orbitofrontal and pregenual cingulate cortex, as well as the insular taste cortex. Top-down cognitive modulation of the representation of affective touch produced by word labels is found in parietal cortex area 7, the insula and ventral striatum. The cognitive labels also influence activations to the sight of touch and also the correlations with pleasantness in the pregenual cingulate/orbitofrontal cortex and ventral striatum.