Task-dependency of the neural correlates of episodic encoding as measured by fMRI.

Using event-related functional magnetic resonance imaging (fMRI), the neural correlates of memory encoding can be studied by contrasting item-related activity elicited in a study task according to whether the items are remembered or forgotten in a subsequent memory test. Previous studies using this approach have implicated the left prefrontal cortex in the successful encoding of verbal material into episodic memory when the study task is semantic in nature. In the current study, we asked whether the neural correlates of episodic encoding differ depending on type of study task. Seventeen volunteers participated in an event-related fMRI experiment in which at study, volunteers were cued to make either animacy or syllable judgements about words. A recognition memory test followed after a delay of approximately 15 min. For the animacy task, words that were subsequently remembered showed greater activation in left and medial prefrontal regions. For the syllable task, by contrast, successful memory for words was associated with activations in bilateral intraparietal sulcus, bilateral fusiform gyrus, right prefrontal cortex and left superior occipital gyrus. These findings suggest that the brain networks supporting episodic encoding differ according to study task.     

Right prefrontal activation during encoding, but not during retrieval, in a non-verbal paired-associates task

Brain imaging studies have shown that episodic encoding into long-term memory preferentially activates the left prefrontal cortex and retrieval activates the right prefrontal cortex. However, it is unclear to what degree verbal analysis contributes to the left prefrontal activation during encoding. The present study was designed to avoid verbal analysis during encoding by using abstract pictures and computer- generated sounds which were difficult to code verbally. Sounds and pictures were grouped into six stimulus-stimulus pairs. When the sound from a pair was presented, the subjects were instructed to recall and visualize the associated picture. After 2.0 s the associated picture and another picture appeared on the screen and the subjects were required to identify the associated picture. Feedback about the choice was then given. Regional cerebral blood flow (rCBF) was measured with [15O]butanol and positron emission tomography (PET) in 10 subjects during initial training on the paired-associates task (encoding scan) and after 35 min of training (retrieval scan). Performance during the encoding scan was 59% correct and during the retrieval scan 98% correct, with a mean reaction time of 709 ms during retrieval. The rCBF was also measured during a control condition without any instruction to encode or retrieve. Compared with retrieval, encoding showed significant activation of the posterior part of the right middle frontal gyrus, the right inferior parietal cortex, the cingulate cortex, the left inferior parietal cortex and the left inferior and middle temporal gyri. The rCBF increase during encoding was strongly correlated with the rate of encoding. Retrieval was compared with both encoding and control. In none of these comparisons was there any prefrontal activation. The lack of prefrontal activation during near- perfect performance of the retrieval task suggests that the prefrontal cortex is not necessarily active when retrieval is fast and accurate, or what might be called automatic. Encoding was not associated with more activation of the left than the right prefrontal cortex. This result presents a limitation to the generality of left prefrontal activation during episodic encoding, which has been found in several previous brain imaging studies. Differences between studies in the relative activation of left and right prefrontal cortex during encoding and retrieval might be due to differences in paradigms, the type of stimulus used, and the demand for working memory and verbal analysis.      

The relationship between aging, performance, and the neural correlates of successful memory encoding

The present functional magnetic resonance imaging (fMRI) study investigated whether age-related differences in the neural correlates of successful memory encoding are modulated by memory performance. Young (mean age 22 years; N = 16) and older (mean age 69 years; N = 32) subjects were scanned while making animacy decisions on visually presented words. Memory for the words was later assessed in a recognition test, allowing fMRI activity elicited by study words to be contrasted according to subsequent memory performance. Young and older adults exhibited equivalent subsequent memory effects (enhanced activity for later remembered items) in an extensive network that included left inferior prefrontal cortex and anterior hippocampus. In posterior cingulate cortex, reversed subsequent memory effects (greater activity for later forgotten items) were of greater magnitude in young subjects. A voxel-of-interest analysis conducted on left and right prefrontal subsequent memory effects revealed that the effects were distributed more bilaterally in older than in young subjects, replicating previous findings. This age-related difference was confined to older subjects with relatively poor recognition performance, who were also the only group to demonstrate statistically significant right prefrontal subsequent memory effects. The findings suggest that relative preservation of memory performance with increasing age does not depend upon right prefrontal "over-recruitment."     

Learning-related neuronal responses in prefrontal cortex studied with functional neuroimaging

We assessed time-dependent neuronal activity accompanying learning using functional magnetic resonance imaging (fMRI). An artificial grammar learning paradigm enabled us to dissociate activations associated with individual item learning from those involved in learning the underlying grammar system. We show that a localized region of right prefrontal cortex (PFC) is preferentially sensitive to individual item learning during the early stages of the experiment, while the left PFC region is sensitive to grammar learning which occurred across the entire course of the experiment. In addition to dissociating these two types of learning, we were able to characterize the effect of rule acquisition on neuronal responses associated with explicit learning of individual items. This effect was expressed as modulation of the time-dependent right PFC activations such that the early increase in activation associated with item learning was attenuated as the experiment progressed. In a further analysis we used structural equation modelling to explore time-dependent changes in inter-regional connectivity as a function of both item and grammar rule learning. Although there were no significant effects of item learning on the measured path strengths, rule learning was associated with a decrease in right fronto-parietal connectivity and an increase in connectivity between left and right PFC. Further fronto-parietal path strengths were observed to change, with an increase in left fronto-parietal and a decrease in right fronto-parietal connectivity path strength from right PFC to left parietal cortex. We interpret our findings in terms of a left frontal system mediating the semantic analysis of study items and directly influencing a right fronto-parietal system associated with episodic memory retrieval.     

Lateralization is predicted by reduced coupling from the left to right prefrontal cortex during semantic decisions on written words

Over 90% of people activate the left hemisphere more than the right hemisphere for language processing. Here, we show that the degree to which language is left lateralized is inversely related to the degree to which left frontal regions drive activity in homotopic right frontal regions. Lateralization was assessed in 60 subjects using functional magnetic resonance imaging (fMRI) activation for semantic decisions on verbal (written words) and nonverbal (pictures of objects) stimuli. Regional interactions between left and right ventral and dorsal frontal regions were assessed using dynamic causal modeling (DCM), random-effects Bayesian model selection at the family level, and Bayesian model averaging at the connection level. We found that 1) semantic decisions on words and pictures modulated interhemispheric coupling between the left and right dorsal frontal regions, 2) activation was more left lateralized for words than pictures, and 3) for words only, left lateralization was greater when the coupling from the left to right dorsal frontal cortex was reduced. These results have theoretical implications for understanding how left and right hemispheres communicate with one another during the processing of lateralized functions.     

The effects of age on the neural correlates of episodic encoding

Young and old adults underwent positron emission tomographic scans while encoding pictures of objects and words using three encoding strategies: deep processing (a semantic living/nonliving judgement), shallow processing (size judgement) and intentional learning. Picture memory exceeded word memory in both young and old groups, and there was an age-related decrement only in word recognition. During the encoding tasks three brain activity patterns were found that differentiated stimulus type and the different encoding strategies. The stimulus-specific pattern was characterized by greater activity in extrastriate and medial temporal cortices during picture encoding, and greater activity in left prefrontal and temporal cortices during encoding of words. The older adults showed this pattern to a significantly lesser degree. A pattern distinguishing deep processing from intentional learning of words and pictures was identified, characterized mainly by differences in prefrontal cortex, and this pattern also was of significantly lesser magnitude in the old group. A final pattern identified areas with increased activity during deep processing and intentional learning of pictures, including left prefrontal and bilateral medial temporal regions. There was no group difference in this pattern. These results indicate age-related dysfunction in several encoding networks, with sparing of one specifically involved in more elaborate encoding of pictures. These age-related changes appear to affect verbal memory more than picture memory.     

Analogical reasoning and prefrontal cortex: evidence for separable retrieval and integration mechanisms

The present study examined the contributions of prefrontal cortex (PFC) subregions to two component processes underlying verbal analogical reasoning: semantic retrieval and integration. Event-related functional magnetic resonance imaging data were acquired while subjects performed propositional analogy and semantic decision tasks. On each trial, subjects viewed a pair of words (pair 1), followed by an instructional cue and a second word pair (pair 2). On analogy trials, subjects evaluated whether pair 2 was semantically analogous to pair 1. On semantic trials, subjects indicated whether the pair 2 words were semantically related to each other. Thus, analogy--but not semantic--trials required integration across multiple retrieved relations. To identify regions involved in semantic retrieval, we manipulated the associative strength of pair 1 words in both tasks. Anterior left inferior PFC (aLIPC) was modulated by associative strength, consistent with a role in controlled semantic retrieval. Left frontopolar cortex was insensitive to associative strength, but was more sensitive to integration demands than was aLIPC, consistent with a role in integrating the products of semantic retrieval to evaluate whether distinct representations are analogous. Right dorsolateral PFC exhibited a profile consistent with a role in response selection rather than retrieval or integration. These findings indicate that verbal analogical reasoning depends on multiple, PFC-mediated computations.     

An information-theoretical approach to contextual processing in the human brain: evidence from prefrontal lesions

Context shapes perception, thought, and action, but little is known about the neural mechanisms supporting these modulations. Here, we addressed the role of lateral prefrontal cortex (PFC) in context updating and maintenance from an information-theoretic perspective. Ten patients with PFC lesions and 10 age-matched controls responded to bilaterally displayed visual targets intermixed with repetitive and novel distracters in 2 different task contexts. In a predictable context, targets were always preceded by a novel event, whereas this temporal contingency was removed in an unpredictable context condition. We applied information theory to the analysis and interpretation of behavioral and electrophysiological data. The results revealed deficits in both the selection and the suppression of familiar versus novel information mainly observed at the visual hemifield contralateral to PFC damage due to disrupted frontocortical and frontosubcortical connectivity. The findings support a deficit in the representation of the temporal contingency between contextually related novel and familiar stimulation subsequent to lateral PFC damage.     

Monitoring and the controlled processing of meaning: distinct prefrontal systems

Distinct prefrontal regions are specialized for the controlled processing of semantic information. We have dissociated components of this system used in semantic decision-making across different perceptual conditions. Nineteen subjects were presented with auditory word sequences, on which they made semantic or syllabic decisions, while neural activity was measured using PET. Contrasting the semantic with syllabic tasks, there was activation within left rostral prefrontal cortex (RPFC) when the stimuli were presented as clear speech, reducing when the stimuli were presented in acoustically degraded form. In contrast, activation of the right dorsolateral prefrontal cortex (DLPFC) was observed with the degraded stimuli, an effect that inversely correlated with accuracy on the task. We have thus demonstrated two prefrontal systems where activity is differentially modulated by the "quality" of information held in working memory. This dissociation is likely to represent an alteration in the type of cognitive operations employed during task performance, where left RPFC is activated during extensive semantic elaboration and right DLPFC is recruited as the monitoring demands, associated with items held in working memory, increase. The function of these separate systems is integrated during the performance of verbal problem-solving tasks although they are differentially sensitive to stimulus degradation.     

Hippocampal and brain stem activation during word retrieval after repeated and semantic encoding

Repeated word presentation during learning and the use of a semantic encoding task both increase the accuracy of subsequent word retrieval. Previous neuroimaging studies have shown that successful word retrieval depends on the recruitment of the hippocampus, whereas the effort of retrieval is linked to activation of prefrontal cortex modules. We studied the effects of repetition (4x versus 1x presentation) and encoding task (semantic versus perceptual) on hippocampal and prefrontal cortex activation during word-stem cued recall using positron emission tomography. Repeated and semantic encoding resulted in increased recall accuracy, with word repetition showing a greater effect when using a semantic encoding task. The more successful retrieval of words presented repeatedly compared with words presented once was associated with activation of the left anterior hippocampus. The more successful retrieval of words encoded using a semantic compared with a perceptual task was associated with activation of the right posterior and, less significantly, the left anterior hippocampus. The greater benefit of repeated learning when using the semantic task was linked to activation of the right brainstem, in the region of the ventral tegmentum. Our results suggest that word repetition and semantic encoding increase recall accuracy during subsequent word retrieval via distinct hippocampal mechanisms and that ventral tegmentum activation is relevant for word retrieval after semantic encoding. These findings confirm the importance of hippocampal recruitment during word retrieval and provide novel evidence for a role of brainstem neurons in word retrieval after semantic encoding.     

Brain activity underlying encoding and retrieval of source memory

Neural activity elicited during the encoding and retrieval of source information was investigated with event-related functional magnetic resonance imaging (efMRI). During encoding, 17 subjects performed a natural/artificial judgement on pictures of common objects which were presented randomly in one of the four quadrants of the display. At retrieval, old pictures were mixed with new ones and subjects judged whether each picture was new or old and, if old, indicated in which quadrant it was presented at encoding. During encoding, study items that were later recognized and assigned a correct source judgement elicited greater activity than recognized items given incorrect judgements in a variety of regions, including right lateral occipital and left prefrontal cortex. At retrieval, regions showing greater activity for recognized items given correct versus incorrect source judgements included the right hippocampal formation and the left prefrontal cortex. These findings indicate a role for these regions in the encoding and retrieval of episodic information beyond that required for simple item recognition.     

Age-related changes in neural activity during visual target detection measured by fMRI

We used functional magnetic resonance imaging (fMRI) of a visual target detection (oddball) task to investigate age differences in neural activation for the detection of two types of infrequent events: visually simple items requiring a response shift (targets) and visually complex items that did not entail a response shift (novels). Targets activated several prefrontal regions (e.g. middle frontal gyrus), as well as deep gray matter regions (caudate, putamen, thalamus and insula). Prefrontal activation was similar for younger and older adults, whereas deep gray matter activation was relatively greater for the older adults. Novels activated occipital regions (fusiform and lateral occipital gyri), and this activation was relatively reduced for older adults. The changes in behavioral performance across the task conditions were similar for the two age groups, although the older adults' responses were slower overall. Regression analyses of the relation between neural activation and task performance (response time) indicated that whereas performance was mediated most directly by prefrontal cortex for younger adults, older adults' performance was influenced to a greater extent by deep gray matter structures. Older adults may place relatively greater emphasis on the attentional control of response regulation, in compensation for the age-related decline in visual processing efficiency.     

Hemispheric specialization in human prefrontal cortex for resolving certain and uncertain inferences

Uncertainty is a fact of life that must be accommodated in real-world decision making. Although it has been suggested that the right prefrontal cortex (PFC) has a special role to play in decision making under uncertainty, there is very little hard data to support this hypothesis. To better understand the roles of left and right PFCs in reasoning and decision making in situations with complete and incomplete information, we administered simple inference problems to 18 patients with lateralized focal lesions to PFC (9 right hemisphere, 9 left hemisphere) and 22 age- and education-matched normal controls. The stimuli were systematically manipulated for completeness of information regarding the status of the conclusion. Our results demonstrated a 2-way interaction such that patients with left PFC lesions were selectively impaired in trials with complete information, whereas patients with right PFC lesions were selectively impaired in trials with incomplete information. These results provide compelling evidence for hemispheric specialization for reasoning in PFC and suggest that the right PFC has a critical role to play in reasoning about incompletely specified situations. We postulate this role involves the maintenance of ambiguous mental representations that temper premature overinterpretation by the left hemisphere.     

Changing frontal contributions to memory before and after medial temporal lobectomy

Frontal recruitment was characterized using functional magnetic resonance imaging (fMRI) during memory encoding in temporal lobe epilepsy (TLE) patients before and after unilateral medial temporal lobectomy. Twenty-four TLE patients and 12 healthy controls underwent a preoperative fMRI session consisting of verbal and nonverbal incidental memory-encoding tasks that typically lead to robust, lateralized frontal activity in controls. A similar postoperative fMRI session was performed in a subset of patients. Preoperatively, the verbal task resulted in significant additional recruitment of right frontal cortex in left TLE patients, compared with controls. Right TLE patients instead showed typically lateralized frontal activation. Bilateral frontal recruitment has been observed in older adults and in young adults in situations of difficult task demands. Typical right-lateralized patterns of frontal recruitment were found in both patient groups during the nonverbal task, indicating that the bilateral frontal recruitment pattern was engaged dynamically depending on the task. After surgery, left TLE patients regained more lateralized frontal activity. These results demonstrated differences in frontal recruitment in left and right TLE patients. Such differences emerged in specific task settings and were influenced by surgery, suggesting a dynamic mechanism of frontal recruitment that can be obtained in TLE patients, possibly as a response to presurgical dysfunction.     

Category-specific conceptual processing of color and form in left fronto-temporal cortex

To investigate the cortical basis of color and form concepts, we examined event-related functional magnetic resonance imaging (fMRI) responses to matched words related to abstract color and form information. Silent word reading elicited activity in left temporal and frontal cortex, where category-specific activity differences were also observed. Whereas color words preferentially activated anterior parahippocampal gyrus, form words evoked category-specific activity in fusiform and middle temporal gyrus as well as premotor and dorsolateral prefrontal areas in inferior and middle frontal gyri. These results demonstrate that word meanings and concepts are not processed by a unique cortical area, but by different sets of areas, each of which may contribute differentially to conceptual semantic processing. We hypothesize that the anterior parahippocampal activation to color words indexes computation of the visual feature conjunctions and disjunctions necessary for classifying visual stimuli under a color concept. The predominant premotor and prefrontal activation to form words suggests action-related information processing and may reflect the involvement of neuronal elements responding in an either-or fashion to mirror neurons related to adumbrating shapes.     

Neuroanatomy of "hearing voices": a frontotemporal brain structural abnormality associated with auditory hallucinations in schizophrenia

Auditory hallucinations are a frequent symptom in schizophrenia. While functional imaging studies have suggested the association of certain patterns of brain activity with sub-syndromes or single symptoms (e.g. positive symptoms such as hallucinations), there has been only limited evidence from structural imaging or post-mortem studies. In this study, we investigated the relation of local brain structural deficits to severity of auditory hallucinations, particularly in perisylvian areas previously reported to be involved in auditory hallucinations. In order to overcome certain limitations of conventional volumetric methods, we used deformation-based morphometry (DBM), a novel automated whole-brain morphometric technique, to assess local gray and white matter deficits in structural magnetic resonance images of 85 schizophrenia patients. We found severity of auditory hallucinations to be significantly correlated (P < 0.001) with volume loss in the left transverse temporal gyrus of Heschl (primary auditory cortex) and left (inferior) supramarginal gyrus, as well as middle/inferior right prefrontal gyri. This demonstrates a pattern of distributed structural abnormalities specific for auditory hallucinations and suggests hallucination-specific alterations in areas of a frontotemporal network for processing auditory information and language.     

Disturbing visual working memory: electrophysiological evidence for a role of the prefrontal cortex in recovery from interference

Single cell recordings in monkeys support the notion that the lateral prefrontal cortex (PFC) controls reactivation of visual working memory representations when rehearsal is disrupted. In contrast, recent fMRI findings yielded a double dissociation for PFC and the medial temporal lobe (MTL) in a letter working memory task. PFC was engaged in interference protection during reactivation while MTL was prominently involved in the retrieval of the letter representations. We present event-related potential data (ERP) that support PFC involvement in the top-down control of reactivation during a visual working memory task with endogenously triggered recovery after visual interference. A differentiating view is proposed for the role of PFC in working memory with respect to endogenous/exogenous control and to stimulus type. General implications for binding and retention mechanisms are discussed.     

Dissociating the roles of right ventral lateral and dorsal lateral prefrontal cortex in generation and maintenance of hypotheses in set-shift problems

Although patient data have traditionally implicated the left prefrontal cortex (PFC) in hypothesis generation, recent lesion data implicate right PFC in hypothesis generation tasks that involve set shifts (lateral transformations). To test the involvement of the right prefrontal cortex in a hypothesis generation task involving set shifts, we scanned 13 normal subjects with fMRI as they completed Match Problems (a classic divergent thinking task) and a baseline task. In Match Problems subjects determined the number of possible solutions for each trial. Successful solutions are indicative of set shifts. In the baseline condition subjects evaluated the accuracy of hypothetical solutions to match problems. A comparison of Match Problems versus baseline trials revealed activation in right ventral lateral PFC (BA 47) and left dorsal lateral PFC (BA 46). A further comparison of successfully versus unsuccessfully completed Match Problems revealed activation in right ventral lateral PFC (BA 47), left middle frontal gyrus (BA 9) and left frontal pole (BA 10), thus identifying the former as a critical component of the neural mechanisms of set-shift transformation. By contrast, activation in right dorsal lateral PFC (BA 46) covaried as a function of the number of solutions generated in Match Problems, possibly due to increased working memory demands to maintain multiple solutions 'on-line', conflict resolution, or progress monitoring. These results go beyond the patient data by identifying the ventral lateral (BA 47) aspect of right PFC as being a critical component of the neural systems underlying lateral transformations, and demonstrate a dissociation between right VLPFC and DLPFC in hypotheses generation and maintenance.     

Neural correlates of true memory, false memory, and deception

We used functional magnetic resonance imaging (fMRI) to determine whether neural activity can differentiate between true memory, false memory, and deception. Subjects heard a series of semantically related words and were later asked to make a recognition judgment of old words, semantically related nonstudied words (lures for false recognition), and unrelated new words. They were also asked to make a deceptive response to half of the old and unrelated new words. There were 3 main findings. First, consistent with the notion that executive function supports deception, 2 types of deception (pretending to know and pretending not to know) recruited prefrontal activity. Second, consistent with the sensory reactivation hypothesis, the difference between true recognition and false recognition was found in the left temporoparietal regions probably engaged in the encoding of auditorily presented words. Third, the left prefrontal cortex was activated during pretending to know relative to correct rejection and false recognition, whereas the right anterior hippocampus was activated during false recognition relative to correct rejection and pretending to know. These findings indicate that fMRI can detect the difference in brain activity between deception and false memory despite the fact that subjects respond with "I know" to novel events in both processes.     

Long-term potentiation induces expanded movement representations and dendritic hypertrophy in layer V of rat sensorimotor neocortex

While long-term potentiation (LTP) is currently the most widely investigated model of the synaptic mechanisms underlying learning, there is a paucity of reports on the direct effects of LTP on cortical organization. Here we show that strengthening polysynaptic potentiation correlates with an expanded neocortical area that responds to intracortical microstimulation-induced movements of rat forelimb and increased dendritic material in layer V pyramidal cells. Rats carried a stimulating electrode in the corpus callosum (midline), and a recording electrode in the right caudal forelimb area (CFA). Each rat received 15 days of either high frequency stimulation (HFS) or handling. Evoked potentials of the transcallosal pathway were recorded in the right hemisphere before and after 15 days of stimulation or handling. Following the last stimulation, movement representations were determined in the left CFA using high-resolution intracortical microstimulation (ICMS) and then the brains were processed for Golgi-Cox staining. Our results show that synaptic modification results in a recruitment of more neocortical area into movement representations and increases in several measures of dendritic morphology in layers III and V. This study sheds light on the interaction between artificial models of learning, receptive field characteristics and dendritic morphology in the sensorimotor cortex.