Context-dependent responses of primate nucleus basalis neurons in a go/no-go task

In previous studies involving monkeys performing behavioral tasks, neurons in the nucleus basalis frequently had significant changes in discharge rate when the animal made a movement in response to a sensory stimulus in order to obtain a reward. To determine whether such responses of basalis neurons are primarily sensory or motor in nature, the activity of single basalis neurons was recorded in monkeys performing a go/no-go (GNG) task which provided a dissociation between sensory and motor neuronal responses. In a sample of 425 basalis neurons, 326 (77%) had significant changes in firing in at least one phase of the GNG task. Most of the task-related neurons (70%) responded in the choice phase in which the animal either made an arm movement (go condition) or kept its arm motionless (no-go condition) in order to obtain a water reward. Of 253 neurons that responded in the choice phase, 88% had changes in firing in the no-go condition that were equal to or, in some cases, greater than the changes in firing in the go condition. Therefore, most responses of basalis neurons in the choice phase could not be specific for the arm movement because they occurred when there was no arm movement at all. The visual stimulus presented in the choice phase was also presented earlier on each trial in the cue phase. Although 70% of the task-related basalis neurons responded in the choice phase, only 5% had detectable changes in firing in the cue phase. Of 251 neurons responding in the cue or choice phase, 59% had significantly larger changes in firing in the choice phase than in the cue phase, whereas only one neuron had a larger response in the cue phase. Therefore, most responses of basalis neurons in the choice phase could not be specific for the visual stimulus because similar responses did not occur when the same stimulus was presented in the cue phase. These results indicate that the frequent responses of basalis neurons in the choice phase are neither purely sensory nor motor in nature, but are highly dependent on the context of the stimulus or movement. The neuronal responses in the choice phase may reflect either transient increases in arousal or decision-making processes.     

Reward-related neuronal activity in the subthalamic nucleus of the monkey

The subthalamic nucleus is a key structure for motor information processing in the basal ganglia. Little is known about its involvement in other aspects of behavior such as motivation. We investigated neuronal activity in the subthalamic nucleus while a monkey performed arm-reaching movements to obtain a liquid reward. Most neurons were modulated both during the movement and reward phases of the task. The changes in activity occurring after or just before the delivery of reward consisted of either increases or decreases in firing and were not directly related to mouth movements. These findings indicate that STN neurons are involved in the detection and expectation of reward, consistent with a role for these neurons in the processing of motivational information.     

The human subthalamic nucleus and globus pallidus internus differentially encode reward during action control

The subthalamic nucleus (STN) and globus pallidus internus (GPi) have recently been shown to encode reward, but few studies have been performed in humans. We investigated STN and GPi encoding of reward and loss (i.e., valence) in humans with Parkinson's disease. To test the hypothesis that STN and GPi neurons would change their firing rate in response to reward‐ and loss‐related stimuli, we recorded the activity of individual neurons while participants performed a behavioral task. In the task, action choices were associated with potential rewarding, punitive, or neutral outcomes. We found that STN and GPi neurons encode valence‐related information during action control, but the proportion of valence‐responsive neurons was greater in the STN compared to the GPi. In the STN, reward‐related stimuli mobilized a greater proportion of neurons than loss‐related stimuli. We also found surprising limbic overlap with the sensorimotor regions in both the STN and GPi, and this overlap was greater than has been previously reported. These findings may help to explain alterations in limbic function that have been observed following deep brain stimulation therapy of the STN and GPi. Hum Brain Mapp 38:1952–1964, 2017 . © 2017 Wiley Periodicals, Inc.     

Neurons in primary motor cortex engaged during action observation

Neurons in higher cortical areas appear to become active during action observation, either by mirroring observed actions (termed mirror neurons) or by eliciting mental rehearsal of observed motor acts. We report the existence of neurons in the primary motor cortex (M1), an area that is generally considered to initiate and guide movement performance, responding to viewed actions. Multielectrode recordings in monkeys performing or observing a well‐learned step‐tracking task showed that approximately half of the M1 neurons that were active when monkeys performed the task were also active when they observed the action being performed by a human. These ‘view’ neurons were spatially intermingled with ‘do’ neurons, which are active only during movement performance. Simultaneously recorded ‘view’ neurons comprised two groups: approximately 38% retained the same preferred direction (PD) and timing during performance and viewing, and the remainder (62%) changed their PDs and time lag during viewing as compared with performance. Nevertheless, population activity during viewing was sufficient to predict the direction and trajectory of viewed movements as action unfolded, although less accurately than during performance. ‘View’ neurons became less active and contained poorer representations of action when only subcomponents of the task were being viewed. M1 ‘view’ neurons thus appear to reflect aspects of a learned movement when observed in others, and form part of a broadly engaged set of cortical areas routinely responding to learned behaviors. These findings suggest that viewing a learned action elicits replay of aspects of M1 activity needed to perform the observed action, and could additionally reflect processing related to understanding, learning or mentally rehearsing action.     

Neuronal control and monitoring of initiation of movements

The prerequisite for behavioral self-control is the ability to initiate actions and to cancel planned actions. A rational choice about which action to initiate or to withhold must be informed by the consequences of prior actions. The neuronal correlates of these processes have been studied with the countermanding paradigm. This task requires subjects to withhold planned movements in response to an imperative stop signal, which they can do with varying success. By recording the activity of single neurons in different parts of the frontal cortex of macaque monkeys performing this task, signals that are sufficient for controlling the initiation and inhibition of movements and other signals that evaluate the consequences of these movements have been identified.     

Neuronal activity in the subthalamic nucleus modulates the release of dopamine in the monkey striatum

The primate subthalamic nucleus (STN) is commonly seen as a relay nucleus between the external and internal pallidal segments, and as an input station for cortical and thalamic information into the basal ganglia. In rodents, STN activity is also known to influence neuronal activity in the dopaminergic substantia nigra pars compacta (SNc) through inhibitory and excitatory mono- and polysynaptic pathways. Although the anatomical connections between STN and SNc are not entirely the same in primates as in rodents, the electrophysiologic and microdialysis experiments presented here show directly that this functional interaction can also be demonstrated in primates. In three Rhesus monkeys, extracellular recordings from SNc during microinjections into the STN revealed that transient pharmacologic activation of the STN by the acetylcholine receptor agonist carbachol substantially increased burst firing of single nigral neurons. Transient inactivation of the STN with microinjections of the GABA-A receptor agonist muscimol had the opposite effect. While the firing rates of individual SNc neurons changed in response to the activation or inactivation of the STN, these changes were not consistent across the entire population of SNc cells. Permanent lesions of the STN, produced in two animals with the fiber-sparing neurotoxin ibotenic acid, reduced burst firing and firing rates of SNc neurons, and substantially decreased dopamine levels in the primary recipient area of SNc projections, the striatum, as measured with microdialysis. These results suggest that activity in the primate SNc is prominently influenced by neuronal discharge in the STN, which may thus alter dopamine release in the striatum.     

Neurophysiological identification of the subthalamic nucleus in surgery for Parkinson's disease

Microelectrode recording methods for stereotactic localization of the subthalamic nucleus (STN) and surrounding structures are described. These methods accurately define targets for chronic deep brain stimulation in the treatment of Parkinson's disease. Mean firing rates and a burst index were determined for all recorded neurons, and responses to active and passive limb and orofacial movements were tested. STN neurons had a mean firing rate of 37 ± 17 Hz (n = 248) and an irregular firing pattern (median burst index, 3.3). Movement-related activity and tremor cells were identified in the STN. Ventral to the STN, substantia nigra pars reticulata neurons had a mean rate of 71 ± 23 Hz (n = 56) and a more regular firing pattern (median burst index, 1.7). Short trains (1–2 seconds) of electrical microstimulation of STN could produce tremor arrest but were and found to be useful for localization. Compared with data from normal monkeys our findings suggest that STN neuronal activity is elevated in Parkinson's disease.     

Fixational saccade‐related activity of pedunculopontine tegmental nucleus neurons in behaving monkeys

Fixational saccades are small, involuntary eye movements that occur during attempted visual fixation. Recent studies suggested that several cognitive processes affect the occurrence probability of fixational saccades. Thus, there might be an interaction between fixational saccade‐related motor signals and cognitive signals. The pedunculopontine tegmental nucleus (PPTN) in the brainstem has anatomical connections with numerous saccade‐related and limbic areas. Previously, we reported that a group of PPTN neurons showed transient phasic bursts or a pause in activity during large visually guided and spontaneous saccades, and also showed sustained tonic changes in activity with task context. We hypothesised that single PPTN neurons would relay both fixational saccade‐related and task context‐related signals, and might function as an interface between the motor and limbic systems. We recorded the activity of PPTN neurons in behaving monkeys during a reward‐biased task, and analysed neuronal activity for small fixational saccades during visual fixation, and compared it with the activity for large visually guided targeting saccades and large spontaneous saccades during intertrial intervals. A population of PPTN neurons exhibited a fixational saccade‐related phasic increase in activity, and the majority of them also showed activity modulation with large targeting saccades. In addition, a group of these neurons showed a task‐related tonic increase in activity during the fixation period, and half of them relayed the saccade signal only when the neuron exhibited higher tonic activity during the task execution period. Thus, fixational saccade‐related signals of PPTN neurons overlap with tonic task‐related signals, and might contribute to the cognitive modulation of fixational saccades.     

Neuronal Activity in the Premotor Cortex of Monkeys Reflects Both Cue Salience and Motivation for Action Generation and Inhibition

Reward prospect weighs on motor decision processes, enhancing the selection of appropriate actions and the inhibition of others. While many studies have investigated the neuronal basis of reward representations and of cortical control of actions, the neuronal correlates of the influences of reward prospect on motor decisions are less clear. We recorded from the dorsal premotor cortex (PMd) of 2 male macaque monkeys performing a modified version of the Stop-signal (countermanding) task. This task challenges motor decisions by requiring responding to a frequent Go stimulus, but to suppress this response when a rare Stop signal is presented during the reaction time. We unbalanced the motivation to respond or to suppress the response by presenting a cue informing on three different rewards schedules: in one case, Go trials were rewarded more than Stop trials; in another case, Stop trials were rewarded more than Go trials; in the last case, both types of trials were rewarded equally. Monkeys adopted different strategies according to reward information provided by the cue: the higher the reward for Stop trials, the higher their ability to suppress the response and the slower their response to Go stimuli. PMd neuronal activity evolved in time and correlated with the behavior: PMd signaled first the cue salience, representing the chance to earn the highest reward at stake, then reflected the shaping of the motor choice by the motivation to move or to stop. These findings represent a neuronal correlate of the influence of reward information on motor decision.SIGNIFICANCE STATEMENT The motivation to obtain rewards drives how animals act over their environment. To explore the involvement of motor cortices in motivated behaviors, we recorded high-resolution neuronal activity in the premotor cortex of monkeys performing a task that manipulated the motivation to generate/withhold a movement through different cued reward probabilities. Our results show the presence of neuronal signals dynamically reflecting the salience of the cue, in the time immediately following its presentation, and a motivation-related activity in performing (or cancelling) a motor program, while the behavioral response approached. The encoding of multiple reward-related signals in this region leads to consider an important role of premotor areas in the reward circuitry supporting action.     

Motivation-related neuronal activity in the object discrimination task in monkey septal nuclei

Septal nuclei are suggested to work as an interface between the hippocampal formation, involved in higher cognitive functions, and the hypothalamus, involved in motivational behaviors such as feeding, drinking, and intracranial self-stimulation. In the present study, to elucidate a role of the septal nuclei in motivational behaviors, single neuron activity was recorded from water- and food-deprived monkeys during discrimination of objects associated with juice, and during ingestion of juice. Of 349 neurons recorded from two monkeys, 67 responded in the ingestion phase of the object discrimination task. Of these 67 neurons, 31 were further tested with the noncontingent liquid (juice or water) test in which liquid was provided until the animals became satiated. These 31 septal neurons were classified into two groups: type I neurons (n = 10) responded to juice ingestion with inhibition, and type II neurons (n = 21) responded with excitation. The spontaneous firing rates of the type I neurons were higher in the deprived condition and decreased as the animal became satiated by intake of liquid. Nine type II neurons responded to the sight of a white object associated with juice as well as ingestion of juice. The response magnitudes of the type II neurons to both the sight of the white object and ingestion of juice also decreased by satiation. However, spontaneous firing rates of the type II neurons did not change. These activity changes of both type I and II neurons were well correlated with changes in motivational state of the monkey estimated by the behavioral test. The results suggest that the activity of type I neurons reflects thirst or hunger drive levels, and that responses of type II neurons are related to reward perception. These type I and II neurons were located mainly in the anterior part of the septal nuclei. Results of the present study suggest, along with previous lesion and anatomical studies, that the septal nuclei exert a powerful influence on the motivational/drive systems through the projection to the hypothalamus. Hippocampus 1997;7:536–548. © 1997 Wiley-Liss, Inc.     

Neurons in the pigeon nidopallium caudolaterale signal the selection and execution of perceptual decisions

Sensory systems provide organisms with information on the current status of the environment, thus enabling adaptive behavior. The neural mechanisms by which sensory information is exploited for action selection are typically studied with mammalian subjects performing perceptual decision‐making tasks, and most of what is known about these mechanisms at the single‐neuron level is derived from cortical recordings in behaving monkeys. To explore the generality of neural mechanisms underlying perceptual decision making across species, we recorded single‐neuron activity in the pigeon nidopallium caudolaterale (NCL), a non‐laminated associative forebrain structure thought to be functionally equivalent to mammalian prefrontal cortex, while subjects performed a visual categorisation task. We found that, whereas the majority of NCL neurons unspecifically upregulated or downregulated activity during stimulus presentation, ~20% of neurons exhibited differential activity for the sample stimuli and predicted upcoming choices. Moreover, neural activity in these neurons was ramping up during stimulus presentation and remained elevated until a choice was initiated, a response pattern similar to that found in monkey prefrontal and parietal cortices in saccadic choice tasks. In addition, many NCL neurons coded for movement direction during choice execution and differentiated between choice outcomes (reward and punishment). Taken together, our results implicate the NCL in the selection and execution of operant responses, an interpretation resonating well with the results of previous lesion studies. The resemblance of the response patterns of NCL neurons to those observed in mammalian cortex suggests that, despite differing neural architectures, mechanisms for perceptual decision making are similar across classes of vertebrates.     

Neural correlates of reward and attention in macaque area LIP

Saccade reaction times decrease and the frequency of target choices increases with the size of rewards delivered for orienting to a particular visual target. Similarly, increasing rewards for orienting to a visual target enhances neuronal responses in the macaque lateral intraparietal area (LIP), as well as other brain areas. These observations raise several questions. First, are reward-related modulations in neuronal activity in LIP, as well as other areas, spatially specific or more global in nature? Second, to what extent does reward modulation of neuronal activity in area LIP reflect changes in visual rather than motor processing? And third, to what degree are reward-related modulations in LIP activity independent of performance-related modulations thought to reflect changes in attention? Here we show that increasing the size of fluid rewards in blocks reduced saccade reaction times and improved performance in monkeys performing a peripherally-cued saccade task. LIP neurons responded to visual cues spatially segregated from the saccade target, and for many neurons visual responses were systematically modulated by expected reward size. Neuronal responses also were positively correlated with reaction times independent of reward size, consistent with re-orienting of attention to the saccade target. These observations suggest that motivation and attention independently contribute to the strength of sustained visual responses in LIP. Our data thus implicate LIP in the integration of the sensory, motor, and motivational variables that guide orienting.     

Tonically active neurons in the striatum differentiate between delivery and omission of expected reward in a probabilistic task context

Tonically active neurons (TANs) in the primate striatum are responsive to rewarding stimuli and they are thought to be involved in the storage of stimulus–reward associations or habits. However, it is unclear whether these neurons may signal the difference between the prediction of reward and its actual outcome as a possible neuronal correlate of reward prediction errors at the striatal level. To address this question, we studied the activity of TANs from three monkeys trained in a classical conditioning task in which a liquid reward was preceded by a visual stimulus and reward probability was systematically varied between blocks of trials. The monkeys' ability to discriminate the conditions according to probability was assessed by monitoring their mouth movements during the stimulus–reward interval. We found that the typical TAN pause responses to the delivery of reward were markedly enhanced as the probability of reward decreased, whereas responses to the predictive stimulus were somewhat stronger for high reward probability. In addition, TAN responses to the omission of reward consisted of either decreases or increases in activity that became stronger with increasing reward probability. It therefore appears that one group of neurons differentially responded to reward delivery and reward omission with changes in activity into opposite directions, while another group responded in the same direction. These data indicate that only a subset of TANs could detect the extent to which reward occurs differently than predicted, thus contributing to the encoding of positive and negative reward prediction errors that is relevant to reinforcement learning.     

Encoding of social state information by neuronal activities in the macaque caudate nucleus

Social animals adjust their behavior according to social relationships and momentary circumstances. Dominant–submissive relationships modulate, but do not completely determine, their competitive behaviors. For example, a submissive monkey's decision to retrieve food depends not only on the presence of dominant partners but also on their observed behavior. Thus, behavioral expression requires a dynamic evaluation of reward outcome and momentary social states. The neural mechanisms underlying this evaluation remain elusive. The caudate nucleus (CN) plays a pivotal role in representing reward expectation and translating it into action selection. To investigate whether their activities encode social state information, we recorded from CN neurons in monkeys while they performed a competitive food-grab task against a dominant competitor. We found two groups of CN neurons: one primarily responded to reward outcome, while the other primarily tracked the monkey's social state. These social state-dependent neurons showed greater activity when the monkeys freely retrieved food without active challenges from the competitor and reduced activity when the monkeys were in a submissive state due to the competitor's active behavior. These results indicate that different neuronal activities in the CN encode social state information and reward-related information, which may contribute to adjusting competitive behavior in dynamic social contexts.     

Encoding of social state information by neuronal activities in the macaque caudate nucleus

Social animals adjust their behavior according to social relationships and momentary circumstances. Dominant-submissive relationships modulate, but do not completely determine, their competitive behaviors. For example, a submissive monkey's decision to retrieve food depends not only on the presence of dominant partners but also on their observed behavior. Thus, behavioral expression requires a dynamic evaluation of reward outcome and momentary social states. The neural mechanisms underlying this evaluation remain elusive. The caudate nucleus (CN) plays a pivotal role in representing reward expectation and translating it into action selection. To investigate whether their activities encode social state information, we recorded from CN neurons in monkeys while they performed a competitive food-grab task against a dominant competitor. We found two groups of CN neurons: one primarily responded to reward outcome, while the other primarily tracked the monkey's social state. These social state-dependent neurons showed greater activity when the monkeys freely retrieved food without active challenges from the competitor and reduced activity when the monkeys were in a submissive state due to the competitor's active behavior. These results indicate that different neuronal activities in the CN encode social state information and reward-related information, which may contribute to adjusting competitive behavior in dynamic social contexts.     

Neuronal basis for evaluating selected action in the primate striatum

Humans and animals optimize their behavior by evaluating outcomes of individual actions and predicting how much reward the actions will yield. While the estimated values of actions guide choice behavior, the choices are also governed by other behavioral norms, such as rules and strategies. Values, rules and strategies are represented in neuronal activity, and the striatum is one of the best qualified brain loci where these signals meet. To understand the role of the striatum in value- and strategy-based decision-making, we recorded striatal neurons in macaque monkeys performing a behavioral task in which they searched for a reward target by trial-and-error among three alternatives, earned a reward for a target choice, and then earned additional rewards for choosing the same target. This task allowed us to examine whether and how values of targets and strategy, which were defined as negative-then-search and positive-then-repeat (or win-stay-lose-switch), are represented in the striatum. Large subsets of striatal neurons encoded positive and negative outcome feedbacks of individual decisions and actions. Once monkeys made a choice, signals related to chosen actions, their values and search- or repeat-type actions increased and persisted until the outcome feedback appeared. Subsets of neurons exhibited a tonic increase in activity after the search- and repeat-choices following negative and positive feedback in the last trials as the task strategy monkeys adapted. These activity profiles as a heterogeneous representation of decision variables may underlie a part of the process for reinforcement- and strategy-based evaluation of selected actions in the striatum.     

Subthalamo-pallidal interactions underlying parkinsonian neuronal oscillations in the primate basal ganglia

Parkinson’s disease is characterized by degeneration of nigral dopaminergic neurons, leading to a wide variety of psychomotor dysfunctions. Accumulated evidence suggests that abnormally synchronized oscillations in the basal ganglia contribute to the expression of parkinsonian motor symptoms. However, the mechanism that generates abnormal oscillations in a dopamine‐depleted state remains poorly understood. We addressed this question by examining basal ganglia neuronal activity in two 1‐methyl‐4‐phenyl‐1,2,3,6‐tetrahydropyridine‐treated parkinsonian monkeys. We found that systemic administration of l ‐3,4‐dihydroxyphenylalanine (l ‐DOPA; dopamine precursor) decreased abnormal neuronal oscillations (8–15 Hz) in the internal segment of the globus pallidus (GPi) and the subthalamic nucleus (STN) during the ON state when parkinsonian signs were alleviated and during l ‐DOPA‐induced dyskinesia. GPi oscillations and parkinsonian signs were suppressed by silencing of the STN with infusion of muscimol (GABA_A receptor agonist). Intrapallidal microinjection of a mixture of 3‐(2‐carboxypiperazin‐4‐yl)‐propyl‐1‐phosphonic acid (CPP; N‐methyl‐d ‐aspartate receptor antagonist) and 1,2,3,4‐tetrahydro‐6‐nitro‐2,3‐dioxo‐benzo[f]quinoxaline‐7‐sulfonamide (NBQX; AMPA/kainate receptor antagonist) also decreased the oscillations in the GPi and the external segment of the globus pallidus (GPe). Neuronal oscillations in the STN were suppressed after intrasubthalamic microinjection of CPP/NBQX to block glutamatergic afferents of the STN. The STN oscillations were further reduced by muscimol inactivation of the GPe to block GABAergic inputs from the GPe. These results suggest that, in the dopamine‐depleted state, glutamatergic inputs to the STN and reciprocal GPe–STN interconnections are both important for the generation and amplification of the oscillatory activity of STN neurons, which is subsequently transmitted to the GPi, thus contributing to the symptomatic expression of Parkinson’s disease.     

Motor aspects of cue-related neuronal activity in premotor cortex of the rhesus monkey

Neurons in the premotor cortex of rhesus monkeys were studied under two conditions: (1) visuospatial cues were given to guide the amplitude, direction, and onset time of forearm movements or (2) physically identical visual cues were given when reward was contingent on withholding movement. Neurons with sustained activity following the cues were preferentially active when the cues triggered a movement. Thus, activity of certain neurons in this cortical field is linked to motor set, i.e. intention to make a movement in response to the cue, rather than the visual cue per se.     

Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task

An important function of the prefrontal cortex (PFC) is the control of goal-directed behaviour. This requires information as to whether actions were successful in obtaining desired outcomes such as rewards. While lesion studies implicate a particular PFC region, the orbitofrontal cortex (OFC), in reward processing, neurons encoding reward have been reported in both the OFC and the dorsolateral prefrontal cortex (DLPFC). To compare and contrast their roles, we recorded simultaneously from both areas while two rhesus monkeys (Macaca mulatta) performed a reward preference task. The monkeys had to choose between pictures associated with different amounts of a juice reward. Neuronal activity in both areas reflected the reward amount. However, neurons in the DLPFC encoded both the reward amount and the monkeys' forthcoming response, while neurons in the OFC more often encoded the reward amount alone. Further, reward selectivity arose more rapidly in the OFC than the DLPFC. These results are consistent with reward information entering the PFC via the OFC, where it is passed to the DLPFC and used to control behaviour.     

Single trial-based prediction of a go/no-go decision in monkey superior colliculus.

While some decision-making processes often result in the generation of an observable action, for example eye or limb movements, others may prevent actions and occur without an overt behavioral response. To understand how these decisions are made, one must look directly at their neuronal substrates. We trained two monkeys on a go/no-go task which requires a saccade to a peripheral cue stimulus (go) or maintenance of fixation (no-go). We performed binary regressions on the activity of single neurons in the superior colliculus (SC), with the go/no-go decision as a predictor variable, and constructed a virtual decision function (VDF) designed to provide a good estimation of decision content and its timing in a single trial decision process. Post hoc analyses by VDF correctly predicted the monkey's choice in more than 80% of trials. These results suggest that monitoring of SC activity has sufficient capacity to predict go/no-go decisions on a trial-by-trial basis.