Effects of lesions of the orbitofrontal cortex on sensitivity to delayed and probabilistic reinforcement

RATIONALE: Lesions of the orbital prefrontal cortex (OPFC) can cause pathologically impulsive behaviour in humans. Inter-temporal choice behaviour (choice between reinforcers differing in size, delay and/or probability) has been proposed as a model of "impulsive choice" in animals. OBJECTIVE: The effect of lesions of the OPFC on rats' inter-temporal choice behaviour was examined in two experiments: (1) rats chose between a smaller immediate reinforcer and a larger delayed reinforcer; (2) rats chose between a smaller certain reinforcer and a larger probabilistic reinforcer. METHODS: Under halothane anaesthesia, rats received injections of the excitotoxin quinolinate into the OPFC (0.1 M, 0.5 microl, two injections in each hemisphere), or sham lesions (injections of vehicle). They were trained to press two levers (A and B) for food-pellet reinforcers in discrete-trials schedules. In free-choice trials, a press on A resulted in immediate delivery of one food pellet; a press on B resulted in delivery of two pellets, either following a delay ( d) (experiment 1), or with a probability ( p) <1 (experiment 2). The values of d and p were manipulated across phases of the experiments. The locations of the lesions were verified histologically at the end of the experiment. RESULTS: In experiment 1, both groups showed declining choice of lever B as a function of d. The lesioned rats showed significantly shorter indifference delays ( D50: the value of d corresponding to 50% choice of lever B) than the sham-lesioned rats. In experiment 2, both groups showed declining choice of lever B as a function of the odds against delivery of the two-pellet reinforcer, theta ( theta =[1/ p]-1). The lesioned rats showed lower indifference odds ( theta50: the value of theta corresponding to 50% choice of lever B) than the sham-lesioned rats. In both experiments, the lesioned rats showed extensive atrophy of the OPFC, with sparing of the dorsolateral prefrontal cortex. CONCLUSIONS: The results show that lesions of the OPFC can promote preference for the smaller and more immediate, and the smaller and more certain of two reinforcers. The results are consistent with two interpretations: the lesion may have altered (i) the rates of delay and odds discounting, and/or (ii) sensitivity to the ratio of the sizes of the two reinforcers.     

Effects of central 5-hydroxytryptamine depletion on sensitivity to delayed and probabilistic reinforcement

RATIONALE: The ascending 5-hydroxytryptaminergic (5-HTergic) pathways are believed to be involved in "impulse control". Rats whose 5-HTergic pathways have been destroyed are more liable than intact rats to select a smaller, immediate reinforcer rather than a larger, delayed reinforcer (impulsive choice), and recent evidence indicates that this effect of central 5-HT depletion reflects a change in the rate of time discounting (i.e. a change in the rate at which reinforcers become devalued as a function of delay). Delay of reinforcement and uncertainty of reinforcer delivery are believed to have equivalent effects on choice behaviour. However, it is not known whether central 5-HT depletion affects choice between probabilistic reinforcers. OBJECTIVE: We examined the effects of central 5-HT depletion on choice behaviour in two experiments: In experiment 1, rats chose between a smaller immediate reinforcer and a larger delayed reinforcer; in experiment 2, rats chose between a smaller certain reinforcer and a larger probabilistic reinforcer. METHODS: Rats received injections of 5,7-dihydroxytryptamine into the dorsal and median raphe nuclei or sham lesions. They were trained to press two levers for food-pellet reinforcers in discrete-trials schedules. In free-choice trials, selection of lever A resulted in immediate delivery of one food pellet; selection of lever B resulted in delivery of 2 pellets, either following a delay (dB) (experiment 1) or with a probability (pB) less than 1 (experiment 2). RESULTS: In experiment 1, both groups showed declining choice of lever B (%B) as a function of dB. The lesioned group showed shorter indifference delays (D50: the value of dB corresponding to %B=50) than the sham-lesioned group. In experiment 2, both groups showed declining choice of lever B as a function of the odds against delivery of the two-pellet reinforcer, thetaB (thetaB=[1/pB]-1). There was no difference between the "indifference odds" (theta50: the value of thetaB corresponding to %B=50) between the two groups. In both experiments, the levels of 5-HT and 5-hydroxyindoleacetic acid were reduced in the brains of the lesioned rats, but the levels of noradrenaline and dopamine were not altered. CONCLUSIONS: These results provide additional evidence that central 5-HTergic mechanisms are involved in time discounting, but provide no evidence for a similar role of 5-HT in rats' sensitivity to probabilistic reinforcement.     

Effect of destruction of the 5-hydroxytryptaminergic pathways on behavioural timing and “switching” in a free-operant psychophysical procedure

This experiment examined the effect of destruction of the ascending 5-hydroxytryptaminergic (5HTergic) pathways on performance in a free-operant timing schedule. Rats received either injections of 5,7-dihydroxytryptamine into the dorsal and median raphe nuclei or sham lesions. They were trained to press levers for a sucrose reinforcer. Training sessions consisted of 40, 50-s trials in which reinforcers were available on a variable-interval 25-s schedule; in the first 25 s of each trial, reinforcers were only available for responses on lever A, where in the last 25 s reinforcers were available only for responses on lever B. Data were collected probe trials (four per session) in which no reinforcers were delivered, during the last ten of 50 training sessions. Both groups showed decreasing response rates on lever A and increasing response rates on lever B as a function of time from the onset of the trial. Response rate on lever B, expressed as a percentage of overall response rate, could be described by a two-parameter logistic function; neither the indifference point (i.e the time corresponding to 50% responding on lever B) nor the slope of the function differed between the two groups. However, the lesioned group showed a higher rate of switching between response alternatives than the sham-lesioned group. The levels of 5HT and 5-hydroxyindoleacetic acid were reduced in the brains of the lesioned rats, but the levels of noradrenaline and dopamine were not significantly altered. The results confirm previous findings that behaviour in timing schedules is sensitive to destruction of the central 5HTergic pathways, and suggest that these pathways may contribute to the inhibitory regulation of switching between behavioural states.     

Effect of central 5-hydroxytryptamine depletion on inter-temporal choice: a quantitative analysis

Rationale: It has been proposed that the ascending 5-hydroxytryptaminergic (5-HTergic) pathways are involved in ”impulse control”. Previous experiments have shown that rats whose 5-HTergic pathways have been destroyed are more liable than intact rats to select a smaller, immediate reinforcer rather than a larger, delayed reinforcer (impulsive choice). However, it remains unclear whether this effect of central 5-HT depletion reflects a change in the rate of time discounting (i.e. a change in the rate at which reinforcers become devalued as a function of delay) or a change in sensitivity to reinforcer size. Objective: We examined the effect of central 5-HT depletion on time discounting using a quantitative model of inter-temporal choice (multiplicative hyperbolic model), which enables effects on time discounting to be differentiated from effects on sensitivity to reinforcer size. Methods: Rats received injections of 5,7-dihydroxytryptamine into the dorsal and median raphe nuclei or sham lesions. They were trained to press two levers for food-pellet reinforcers in a discrete-trials adjusting-delay schedule. In free-choice trials, selection of lever A resulted in a brief fixed delay (d _A ) followed by delivery of one pellet; selection of lever B resulted in a longer variable delay (d _B ) followed by delivery of two pellets; d _B was adjusted in accordance with the subject’s choices. The value of d _A was varied (0.5–8.0 s) in successive phasesof the experiment, and the indifference value of d _B was determined in each case. Results: In both groups, the indifference value of d _B was linearly related to the value of d _A ,in accordance with the multiplicative hyperbolic model. The lesioned group showed shorter indifference delays than the sham-lesioned group, this being reflected in a parallel displacement of the linear indifference function. In both experiments, the levels of 5-HT and 5-hydroxyindole-acetic acid were reduced in the brains of the lesioned rats, but the levels of noradrenaline and dopamine were not altered. Conclusions: According to the multiplicative hyperbolic model, parallel displacement of the linear indifference function uniquely specifies a change in time discounting. Thus these results indicate that central 5-HT depletion results in an increase in the rate of time discounting for food reinforcers. Received: 19 October 1999 / Final version: 6 January 2000     

Effect of destruction of the 5-hydroxytryptaminergic pathways on the acquisition of temporal discrimination and memory for duration in a delayed conditional discrimination task

This experiment examined the effect of destruction of the ascending 5-hydroxytryptaminergic (5HTergic) pathways on the acquistion of a temporal discrimination and on memory for duration, using a delayed conditional discrimination task. In phase I, rats that had received injections of 5,7-dihydroxytryptamine into the dorsal and median raphe nuclei, and shamlesioned control rats, were trained in a series of discrete trials to press lever A following a 2-s presentation of a light stimulus, and lever B following an 8-s presentation of the same stimulus. Following stimulus offset, a response on a panel placed midway between the two levers was required in order to intiate lever presentation; a single response on either lever resulted in withdrawal of both levers and, in the case of a correct response, reinforcer delivery. Both groups gradually acquired accurate discrimination, achieving >90% correct choices within 20–30 sessions; the lesioned group acquired accurate performance significantly faster than the control group. In phase II, delays were interposed between stimulus offset and lever presentation in 50% of the trials (2, 4, 8, 16 and 32 s; 10% of trials in each case). Accuracy declined as a function of post-stimulus delay in both groups, and there was no significant difference between the performances of the two groups. Both groups showed an increasing tendency to respond on lever A following longer post-stimulus delays (choose-short effect); this effect was somewhat enhanced in the lesioned group. The levels of 5HT and 5-hydroxyindoleacetic acid were reduced in the brains of the lesioned rats, but the levels of noradrenaline and dopamine were not altered.     

Effect of lesions of the ascending 5-hydroxytryptaminergic pathways on timing behaviour investigated with the fixed-interval peak procedure

Twelve rats received injections of 5,7-dihydroxytryptamine into the dorsal and median raphe nuclei; 12 rats received sham lesions. The rats were then trained for 60 sessions under a discrete-trials fixed-interval schedule (peak procedure). In half the trials, a reinforcer became available 40 s after trial onset, and the trial was terminated upon reinforcer delivery; the remaining trials were 120 s in duration, and reinforcement did not occur in these trials. Performance during the 120-s trials was characterized by increasing response rate during the first 40 s of the trial, declining response rate between 40 s and 80 s, and a secondary increase in response rate during the final 40 s of the trial. The lesioned group showed a broader spread of the response rate function than the control group (time between attainment of 70% of the peak response rate and subsequent decline of response rate below this level); however, the peak response rate and the time from trial onset until attainment of the peak response rate did not differ significantly between the groups; the spread/peak-time ratio was significantly greater in the lesioned group than in the control group. The levels of 5-hydroxytryptamine (5HT) and 5-hydroxyindoleacetic acid in the parietal cortex, hippocampus, amygdala, nucleus accumbens and hypothalamus were markedly reduced in the lesioned group, but the levels of noradrenaline and dopamine were not significantly affected by the lesion. The results confirm the involvement of 5HTergic function in timing behaviour.     

Effect of central 5-hydroxytryptamine depletion on tolerance of delay of reinforcement: evidence from performance in a discrete-trials “time-left” procedure

This experiment examined the effect of destruction of the ascending 5-hydroxytryptaminergic (5HTergic) pathways on performance on a new discrete-trials version of the “time-left” procedure. Rats received either injections of 5,7-dihydroxytryptamine into the dorsal and median raphe nuclei or sham lesions. They were trained in a discrete trials schedule in which reinforcers were provided for responding on either of two levers, A and B. At a random time point, t s after the start of each trial, the two levers were inserted into the operant chamber; a response on A resulted in the delivery of one food pellet after d _A s, whereas a response on B resulted in the delivery of two pellets after 84-t s. The value of d _A was varied between 1 and 12 s in different phases of the experiment. Both groups showed an increasing tendency to respond on lever B as a function of time within the trial. Logistic functions were fitted to the data from each group, and a value of the “indifference point” (T ₅₀: the time within the trial at which proportional choice of B attained a value of 50%) was derived for each rat. For each value of d _A, the values of T ₅₀ were significantly greater in the lesioned rats than in the control rats, reflecting a rightward shift of the logistic function in the lesioned group. The levels of 5HT and 5-hydroxyindoleacetic acid were reduced in the brains of the lesioned rats, but the levels of noradrenaline and dopamine were not significantly altered. The results provide further evidence for the involvement of the ascending 5HTergic pathways in the control of operant behaviour by delayed positive reinforcers. Received: 12 January 1998/Final version: 6 May 1998     

Effects of acute and chronic nicotine on impulsive choice in rats

Impulsive choice, or preference for small immediate reinforcers over large delayed reinforcers, has been associated with cigarette smoking. The direct effects of nicotine on impulsive choice in laboratory animals are unknown. We examined the effects of acute and chronic nicotine injections, and the termination of injections, on impulsive choice in rats. Five rats made choices between a one- and a three-pellet reinforcer in a discrete trials procedure. The delay to the smaller reinforcer was always 1 s. A computer adjusted the delay to the larger reinforcer until the pattern of choices reflected indifference between the two alternatives. We assessed the effects of acute and chronic nicotine (vehicle, 0.03, 0.1, 0.3 and 1.0 mg/kg nicotine). The latency to make the first response of the session increased under the acute 1.0 mg/kg dose. There were no consistent differences in the effects of acute and chronic nicotine on response latency and lever pressing during the delays between choices. Acute injections of nicotine dose-dependently increased impulsive responding. After chronic injections, impulsive responding was increased equivalently regardless of dose, and it was increased even in the absence of nicotine. After drug injections were terminated, behavior remained impulsive for about 30 drug-free sessions, and then responding gradually returned to baseline levels. The results suggest that increases in impulsive choice were not due to anorectic effects, response biases or changes in conditioned reinforcement. Nicotine may have decreased the value of delayed reinforcers. Chronic nicotine exposure produced long-lasting but reversible increases in impulsive choice.     

Evidence for an involvement of 5-hydroxytryptaminergic neurones in the maintenance of operant behaviour by positive reinforcement

The possible involvement of the ascending 5-hydroxytryptaminergic (5HTergic) pathways in the maintenance of operant behaviour by positive reinforcement was examined using a quantitative paradigm based on Herrnstein's (1970) equation which defines a hyperbolic relationship between steady-state response rate and reinforcement frequency in variable-interval schedules. Nine rats received injections of 5,7-dihydroxytryptamine into the dorsal and median raphe nuclei; 12 rats received sham injections. The rats were trained to steady-state in a series of variable-interval schedules of sucrose reinforcement affording a range of reinforcement frequencies. Herrnstein's equation was fitted to the data obtained from each rat and to the averaged data obtained from the two groups. The value of K_H (the parameter expressing the reinforcement frequency needed to obtain the half-maximum response rate) was significantly lower in the lesioned group than in the control group; the values of R_max (the parameter expressing the maximum response rate) did not differ significantly between the two groups. The levels of 5HT and 5-hydroxyindoleacetic acid in the parietal cortex, hippocampus, nucleus accumbens and hypothalamus were markedly reduced in all four regions in the lesioned group, but the levels of noradrenaline and dopamine were not significantly affected. The results indicate that damage to the central 5HTergic pathways resulted in an increase in the “value” of the sucrose reinforcer, without affecting the animals' response capacity. The results are consistent with the suggestion that the 5HTergic pathways may exert some limiting control on the “values” of certain reinforcers.     

Effects of quinolinic acid-induced lesions of the nucleus accumbens core on inter-temporal choice: a quantitative analysis

Rationale There is evidence that lesions of the nucleus accumbens core (AcbC) promote preference for smaller earlier reinforcers over larger delayed reinforcers in inter-temporal choice paradigms. It is not known whether this reflects an effect of the lesion on the rate of delay discounting, on sensitivity to reinforcer magnitude, or both. Aim We examined the effect of AcbC lesions on inter-temporal choice using a quantitative method that allows effects on delay discounting to be distinguished from effects on sensitivity to reinforcer size. Materials and methods Sixteen rats received bilateral quinolinic acid-induced lesions of the AcbC; 14 received sham lesions. They were trained under a discrete-trials progressive delay schedule to press two levers (A and B) for a sucrose solution. Responses on A delivered 50 μl of the solution after a delay d _A; responses on B delivered 100 μl after d _B. d _B increased across blocks of trials, while d _A was manipulated across phases of the experiment. Indifference delay d _B(50) (value of d _B corresponding to 50% choice of B) was estimated in each phase, and linear indifference functions (d _B(50) vs d _A) derived. Results d _B(50) increased linearly with d _A (r ² > 0.95 in each group). The intercept of the indifference function was lower in the lesioned than the sham-lesioned group; slope did not differ between groups. The lesioned rats had extensive neuronal loss in the AcbC. Conclusions The results confirm that lesions of the AcbC promote preference for smaller, earlier reinforcers and suggest that this reflects an effect of the lesion on the rate of delay discounting.     

Effects of amphetamine and methylphenidate on delay discounting in rats: interactions with order of delay presentation

Rationale

Drug effects on delay discounting are thought to reflect changes in sensitivity to reinforcer delay, although other behavioral mechanisms might be involved. One strategy for revealing the influence of different behavioral mechanisms is to alter features of the procedures in which they are studied.

Objective

This experiment examined whether the order of delay presentation under within-session delay discounting procedures impacts drug effects on discounting.

Methods

Rats responded under a discrete-trial choice procedure in which responses on one lever delivered one food pellet immediately and responses on the other lever delivered three food pellets either immediately or after a delay. The delay to the larger reinforcer (0, 4, 8, 16, and 32 s) was varied within session and the order of delay presentation (ascending or descending) varied between groups.

Results

Amphetamine (0.1–1.78 mg/kg) and methylphenidate (1.0–17.8 mg/kg) shifted delay functions upward in the ascending group (increasing choice of the larger reinforcer) and downward in the descending group (decreasing choice of the larger reinforcer). Morphine (1.0–10.0 mg/kg) and delta-9-tetrahydrocannabinol (0.32–5.6 mg/kg) tended to shift the delay functions downward, regardless of order of delay presentation, thereby reducing choice of the larger reinforcer, even when both reinforcers were delivered immediately.

Conclusion

The effects of amphetamine and methylphenidate under delay discounting procedures differed depending on the order of delay presentation, indicating that drug-induced changes in discounting were due, in part, to mechanisms other than altered sensitivity to reinforcer delay. Instead, amphetamine and methylphenidate altered responding in a manner consistent with increased behavioral perseveration.     

Effect of destruction of the 5-hydroxytryptaminergic pathways on temporal memory: quantitative analysis with a delayed interval bisection task

This experiment examined the effect of destruction of the ascending 5-hydroxytryptaminergic (5HTergic) pathways on memory for duration, using a delayed interval bisection task. Rats that had received injections of 5,7-dihydroxytryptamine into the dorsal and median raphe nuclei, and sham-lesioned control rats, were trained in a series of discrete trials to press lever A following a 2-s presentation of a light stimulus, and lever B following an 8-s presentation of the same stimulus. Following stimulus offset a response on a panel placed midway between the two levers was required in order to initiate lever presentation; a single response on either lever resulted in withdrawal of both levers and, in the case of a ‘correct’ response, reinforcer delivery. When > 90% correct choices had been attained, an 8-s (phase I) or a 12-s (phase II) delay was interposed between stimulus offset and lever presentation in 50% of the trials, and probe trials (10% of both non-delay and delay trials) were introduced in which the light was presented for intermediate durations. Logistic functions were derived relating percent choice of lever B to stimulus duration. In both groups, the imposition of post-stimulus delays displaced the bisection point (duration yielding 50% choice of lever B) towards longer durations; this effect was significantly greater in the lesioned group than in the control group. Imposition of post-stimulus delays resulted in increases in the Weber fraction, which did not differ significantly between the two groups. The levels of 5HT and 5-hydroxyindoleacetic acid were reduced in the brains of the lesioned rats, but the levels of noradrenaline and dopamine were not altered. Received: 30 April 1996 / Final version: 20 August 1996     

Facilitated acquisition of a temporal discrimination following destruction of the ascending 5-hydroxytryptaminergic pathways

This experiment examined the effect of destroying the 5-hydroxytryptaminergic (5HTergic) pathways on the acquisition and performance of discrimination between two brief time intervals. Rats that had received injections of 5,7-dihydroxytryptamine into the dorsal and median raphe nuclei, and sham-lesioned control rats were trained in a series of discrete trials to press lever A following a 200-ms presentation of a light stimulus and lever B following an 800-ms presentation of the same stimulus. Both groups gradually acquired accurate performance, attaining 80%–85% accuracy by the end of 40 sessions. The lesioned group learnt the task significantly faster than the control group. When stable performance had been attained, probe trials were introduced in which the light was presented for intermediate durations. Both groups showed sigmoid functions relating percent choice of lever B to log stimulus duration. The bisection point (duration corresponding to 50% choice of lever B) did not differ significantly between the two groups; however, the Weber fraction was significantly smaller in the lesioned group than in the control group. The levels of 5HT and 5-hydroxy-indole-acetic acid were markedly reduced in the brains of the lesioned rats, but the levels of noradrenaline and dopamine were not altered. The results indicate that destruction of the 5HTergic pathways facilitates acquisition of a temporal discrimination. The lack of an effect of the lesion on the bisection point contrasts with our previous finding using longer stimulus durations; it is suggested that different behavioural processes may underlie millisecond-range and second-range temporal discrimination, and that these may be differently affected by 5HT depletion.     

Effects of acute and repeated administration of caffeine on temporal discounting in rats

Delay to presentation is one variable that can weaken the reinforcing efficacy of an outcome in a choice situation and drugs have been shown to modify such choices. A growing body of literature has examined effects of stimulant drugs on temporal (delay) discounting, but effects of caffeine, the most widely used stimulant in the world, have not previously been assessed. In the present experiment, effects of caffeine (administered acutely and repeatedly) on temporal discounting were analyzed. Male Sprague–Dawley rats (n = 7) chose between a single food pellet delivered immediately after a lever press and three food pellets delivered after a delay. The delay to the three pellets increased within each session, from 0 to 16 s. High doses of caffeine increased large-reinforcer choice relative to control conditions. With repeated caffeine exposure, percent choice for the large reinforcer decreased relative to acute administration, but was still greater than pre-drug baseline. Following withdrawal of drug administration, choice returned to levels seen during pre-drug baseline. Reintroduction of caffeine increased the percent choice for a larger, delayed reinforcer to near acute levels. The results from the present study are consistent with previous research in which stimulant drugs have decreased temporal (delay) discounting.     

Effects of altering reinforcer magnitude and reinforcement schedule on phencyclidine (PCP) self-administration in monkeys using an adjusting delay task

Compared to nondrug reinforcers, few studies have examined delay discounting for drug reinforcers. The purpose of the present study was to examine delay discounting in rhesus monkeys using orally delivered phencyclidine (PCP) as the reinforcer and to examine the effects of manipulating reinforcer magnitude and cost on delay discounting for PCP using an adjusting delay task. Monkeys could choose between a single delivery of PCP available immediately or a bundle of PCP deliveries available following a titrated delay. The average of the delays, or the mean adjusted delay (MAD), served as the quantitative measure of delay discounting. In Experiment 1, reinforcer magnitude was manipulated by varying the PCP concentration and the size of the delayed reinforcer (6 or 12 deliveries). The concentration-effect curve for PCP deliveries assumed an inverted U-shaped function, but varying PCP concentration had little effect on MAD values or the choice between immediate and delayed reinforcers. Increasing the size of the delayed reinforcer produced an upward and leftward shift in the concentration-effect curve. In Experiment 2, the cost of reinforcers was manipulated by increasing the fixed ratio (FR) requirement for each choice. Increasing the FR led to increased MAD values and decreased PCP self-administration.     

Effects of altering reinforcer magnitude and reinforcement schedule on phencyclidine (PCP) self-administration in monkeys using an adjusting delay task

Compared to nondrug reinforcers, few studies have examined delay discounting for drug reinforcers. The purpose of the present study was to examine delay discounting in rhesus monkeys using orally delivered phencyclidine (PCP) as the reinforcer and to examine the effects of manipulating reinforcer magnitude and cost on delay discounting for PCP using an adjusting delay task. Monkeys could choose between a single delivery of PCP available immediately or a bundle of PCP deliveries available following a titrated delay. The average of the delays, or the mean adjusted delay (MAD), served as the quantitative measure of delay discounting. In Experiment 1, reinforcer magnitude was manipulated by varying the PCP concentration and the size of the delayed reinforcer (6 or 12 deliveries). The concentration-effect curve for PCP deliveries assumed an inverted U-shaped function, but varying PCP concentration had little effect on MAD values or the choice between immediate and delayed reinforcers. Increasing the size of the delayed reinforcer produced an upward and leftward shift in the concentration-effect curve. In Experiment 2, the cost of reinforcers was manipulated by increasing the fixed ratio (FR) requirement for each choice. Increasing the FR led to increased MAD values and decreased PCP self-administration.     

Delay discounting of food and remifentanil in rhesus monkeys

Rationale

Drug abuse can be conceptualized as choice between drug and nondrug reinforcers in which drug choice is excessive; factors impacting drug taking can be examined using procedures in which subjects choose between drug and an alternative reinforcer.

Objective

This experiment examined the effects of delayed reinforcement on choice between food and the mu-opioid receptor agonist remifentanil.

Methods

Rhesus monkeys responded under a concurrent fixed-ratio 5, fixed-ratio 5 schedule in which responding on one lever delivered one food pellet and responding on another lever delivered an i.v. infusion.

Results

With no delay, monkeys responded predominantly for food rather than saline or small doses of remifentanil; as the dose of remifentanil increased (0.1–1.0 μg/kg/infusion), monkeys responded more for drug. Delaying delivery (30–240 s) of 0.32 and not 1.0 μg/kg/infusion of remifentanil (food delivered immediately) decreased responding for drug and increased responding for food, resulting in a rightward shift in the remifentanil dose–effect curve. Delaying delivery of food (60–240 s) when doses of remifentanil smaller than 0.32 μg/kg/infusion (but not saline) were available decreased responding for food and increased responding for drug, resulting in a leftward shift in the remifentanil dose–effect curve.

Conclusion

These results provide evidence that delaying the delivery of a mu-opioid receptor agonist reduces its potency as a positive reinforcer; more importantly, delaying the delivery of an alternative nondrug reinforcer (e.g., food) enhances the reinforcing potency of the agonist. Thus, understanding the factors that control substance abuse requires examination of contingencies for both drug and nondrug reinforcers.     

Phosphate and thiophosphate group donating adenine and guanine nucleotides inhibit glibenclamide binding to membranes from pancreatic islets

Summary In microsomes obtained from mouse pancreatic islets, the Mg complex of adenosine 5-triphosphate (MgATP) increased the dissociation constant (K _D) for binding of [³H]glibenclamide by sixfold. In the presence of Mg²⁺, not only ATP but also adenosine 5-0-(3-thiotriphosphate) (ATPS), adenosine 5-diphosphate (ADP), guanosine 5-triphosphate (GTP), guanosine 5-diphosphate (GDP), guanosine 5-0-(3-thiotriphosphate) (GTPTS) and guanosine 5-0-(2-thiodiphosphate) (GDP S) inhibited binding of [³H]glibenclamide. These effects were not observed in the absence of Mg²⁺. Half maximally effective concentrations of the Mg complexes of ATP, ADP, ATPS and GDP were 11.6, 19.0, 62.3 and 90.1 mol/l, respectively. The non-hydrolyzable analogues adenosine 5-(,-imidotriphosphate) (AMP-PNP) and guanosine 5-(,-imidotriphosphate) (GMP-PNP) did not alter [³H]glibenclamide binding in the presence of Mg²⁺. MgADP acted much more slowly than MgATP and both MgADP and MgADP did not inhibit [³H]glibenclamide binding when the concentrations of MgATP and MgATP were kept low by the hexokinase reaction. Development of MgATP-induced inhibition of [³H]glibenclamide binding and dissociation of [³H]-glibenclamide binding occurred at similar rates. However, the reversal of MgATP-induced inhibition of [³H]glibenclamide binding was slower than the association of [³H]glibenclamide with its binding site. Exogenous alkaline phosphatase accelerated the reversal of MgATP-induced inhibition of [³H]glibenclamide binding. MgATP enhanced displacement of [³H]glibenclamide binding by diazoxide. The data suggest that sulfonylureas and diazoxide exert their effects by interaction with the same binding site at the sulfonylurea receptor and that protein phosphorylation modulates the affinity of the receptor.Some of the results described here are part of the medical theses of S. Löser and I. Rietze Send offprint requests to M. Schwanstecher at the above address     

Does the effect of central 5-hydroxytryptamine depletion on timing depend on motivational change?

In a previous experiment we found that destruction of the ascending 5-hydroxytryptaminergic (5HTergic) pathways by microinjection of 5,7-dihydroxytryptamine into the dorsal and median raphe nuclei resulted in impaired acquisition of temporal differentiation under an interresponse-time-greater-than-15-s (IRT>15 s) schedule of sucrose reinforcement. This paper reports three experiments, the results of which bear on the interpretation of that finding. In Experiment 1, 32 rats were trained for 120 sessions under the IRT>15 s schedule; then 16 received lesions of the 5HTergic pathways and 16 received sham lesions. Comparisons of the IRT frequency distributions of the two groups showed that the lesion produced a significant reduction of the mean IRT and an increase in the dispersion of IRTs, as expressed by the coefficient of variation. Obtained reinforcement rates were significantly reduced in the lesioned group, but response rates were not significantly altered. Levels of 5HT and 5-hydroxyindoleacetic acid were markedly reduced in all forebrain areas examined, without significant change in noradrenaline and dopamine levels. The results indicate that destruction of the 5HTergic pathways disrupts performance as well as acquisition of temporal differentiation. Experiments 2 and 3 examined whether changes in deprivation level and reinforcer magnitude, which are known to affect reinforcer value, would influence temporal differentiation in a similar fashion to destruction of the 5HTergic pathways. In experiment 2, 20 rats were trained under the IRT>15 s schedule while maintained at 80% or 90% of free-feeding body weight; the more severe deprivation condition was associated with alonger mean IRT and alower coefficient of variation. In experiment 3, 16 rats were trained under the IRT>15 s schedule using 100 µl or 20 µl of a 0.6 M sucrose solution as the reinforcer; indices of temporal differentiation did not differ between the two conditions. These results indicate that the deleterious effect of destruction of the 5HTergic pathways upon timing behaviour is unlikely to be secondary to the motivation enhancing effect of the lesion.     

Effects of methylphenidate on impulsive choice in adult humans

Rationale Several studies with nonhumans and humans have shown that stimulants decrease impulsive choices on delay-to-reinforcement (self-control) procedures. Little is known, however, about the effects of the stimulant methylphenidate on choice for delayed reinforcers in humans.Objectives The present study was designed to investigate the effects of acute methylphenidate administrations on impulsive responding in adult humans on a delay-to-reinforcement task.Methods Eleven adult males with a history of criminal behavior but no history of attention–deficit hyperactivity disorder (ADHD) participated. Impulsive responding was measured using an adjusting-delay procedure in which subjects were presented with repeated choices between a small amount of money delivered after a short delay and a larger amount of money delivered after a delay that adjusted as a function of previous choices. Subjects were exposed to four experimental sessions each day of participation and 60 min prior to the first daily session received placebo or 0.15, 0.30, or 0.60 mg/kg methylphenidate. Stable choice patterns were re-established between each methylphenidate dose.Results Individuals differed in their sensitivity to methylphenidate, but in over half of the subjects methylphenidate decreased impulsive (i.e., increased the number of self-control choices) and increased the delay to the large reinforcer. The largest increases in self-control choices tended to occur at the 0.30-mg/kg and 0.60-mg/kg doses, and the effects often persisted across multiple daily sessions. In six subjects, under at least one methylphenidate dose, the number of impulsive choices decreased to zero.Conclusions Acute methylphenidate administrations tended to decrease the number of impulsive choices in adult humans on an adjusting-delay procedure, although there were substantial individual differences in the sensitivity of choice to methylphenidate. In no case, however, did methylphenidate increase impulsive choices. These results are consistent with several recent laboratory studies with nonhumans and humans showing that stimulants increase preference for large, delayed reinforcers.