Encoding activity in anterior medial temporal lobe supports subsequent associative recognition

The ability to bind information together, such as linking a name with a face or a car with a parking space, is a vital process in human episodic memory. To identify the neural bases for this binding process, we measured brain activity during a verbal associative encoding task using event-related functional MRI (fMRI), followed by an associative recognition test for the studied word pairs. Analysis of the encoding data sorted by the associative recognition accuracy allowed us to isolate regions involved in successfully creating associations. We found that encoding activity in bilateral anterior medial temporal lobe (MTL) regions was greater for successfully bound pairs, that is, those later recognized as intact, than for all other pairs. These findings provide evidence that the anterior medial temporal lobes support the successful binding of information in memory.     

Distinct neural correlates of associative working memory and long-term memory encoding in the medial temporal lobe

Increasing evidence suggests a role for the hippocampus not only in long-term memory (LTM) but also in relational working memory (WM) processes, challenging the view of the hippocampus as being solely involved in episodic LTM. However, hippocampal involvement reported in some neuroimaging studies using "classical" WM tasks may at least partly reflect incidental LTM encoding. To disentangle WM processing and LTM formation we administered a delayed-match-to-sample associative WM task in an event-related fMRI study design. Each trial of the WM task consisted of four pairs of faces and houses, which had to be maintained during a delay of 10s. This was followed by a probe phase consisting of three consecutively presented pairs; for each pair participants were to indicate whether it matched one of the pairs of the encoding phase. After scanning, an unexpected recognition-memory (LTM) task was administered. Brain activity during encoding was analyzed based on WM and LTM performance. Hence, encoding-related activity predicting WM success in the absence of successful LTM formation could be isolated. Furthermore, regions critical for successful LTM formation for pairs previously correctly processed in WM were analyzed. Results showed that the left parahippocampal gyrus including the fusiform gyrus predicted subsequent accuracy on WM decisions. The right anterior hippocampus and left inferior frontal gyrus, in contrast, predicted successful LTM for pairs that were previously correctly classified in the WM task. Our results suggest that brain regions associated with higher-level visuo-perceptual processing are involved in successful associative WM encoding, whereas the anterior hippocampus and left inferior frontal gyrus are involved in successful LTM formation during incidental encoding.     

Prefrontal and hippocampal contributions to the generation and binding of semantic associations during successful encoding

The ability to form and bind associations between items is an important aspect of successful memory formation. We hypothesize that, during encoding, the left inferior frontal gyrus (IFG) supports generation of associations between items and the hippocampus then binds these associations. This study examined the parametric responses of these regions to varying amounts of generative and relational processing during successful encoding (i.e., for subsequently recognized items). Encoding involved presentation of word triads varying in the number of semantic associations among them (none, one or all); participants judged how many associations were present in each triad. Thus, triads with fewer associations had higher generative load while triads with more associations had higher relational load. Participants later completed a forced-choice recognition test for encoding triads. Successful encoding relative to a control task resulted in activation of bilateral IFG and left hippocampus, and the hippocampus also exhibited a significant subsequent memory effect (hits>misses). Linear parametric analyses revealed that generative load modulated activity in bilateral IFG while relational load correlated with activity in left hippocampus. Although univariate analyses distinguished IFG and hippocampal contributions to the generative and relational stages of encoding, respectively, effective connectivity between these regions did not differ according to condition. Furthermore, this analysis revealed that the left IFG played a pivotal role in coordinating associative encoding processes. Our findings illustrate that modulation of components in a memory network can be independent of patterns of mutual connectivity among those components in mediating successful encoding.     

Effects of semantic relatedness on age-related associative memory deficits: the role of theta oscillations

Growing evidence suggests that age-related deficits in associative memory are alleviated when the to-be-associated items are semantically related. Here we investigate whether this beneficial effect of semantic relatedness is paralleled by spatio-temporal changes in cortical EEG dynamics during incidental encoding. Young and older adults were presented with faces at a particular spatial location preceded by a biographical cue that was either semantically related or unrelated. As expected, automatic encoding of face-location associations benefited from semantic relatedness in the two groups of age. This effect correlated with increased power of theta oscillations over medial and anterior lateral regions of the prefrontal cortex (PFC) and lateral regions of the posterior parietal cortex (PPC) in both groups. But better-performing elders also showed increased brain-behavior correlation in the theta band over the right inferior frontal gyrus (IFG) as compared to young adults. Semantic relatedness was, however, insufficient to fully eliminate age-related differences in associative memory. In line with this finding, poorer-performing elders relative to young adults showed significant reductions of theta power in the left IFG that were further predictive of behavioral impairment in the recognition task. All together, these results suggest that older adults benefit less than young adults from executive processes during encoding mainly due to neural inefficiency over regions of the left ventrolateral prefrontal cortex (VLPFC). But this associative deficit may be partially compensated for by engaging preexistent semantic knowledge, which likely leads to an efficient recruitment of attentional and integration processes supported by the left PPC and left anterior PFC respectively, together with neural compensatory mechanisms governed by the right VLPFC.     

Item- and task-level processes in the left inferior prefrontal cortex: positive and negative correlates of encoding

Activity in the left inferior prefrontal cortex (LIPC) is often thought to reflect processes that support episodic encoding. Functional magnetic resonance imaging (fMRI) was used to test whether processes subserved by LIPC could be negatively related to subsequent memory performance. Specifically, the current experiment explicitly tested the hypothesis that LIPC processing would positively impact encoding when primarily focused towards specific target items (item-level processing), whereas it would negatively impact encoding when primarily focused on the retrieval and instantiation of current task instructions (task-level processing). Two methods were used to identify regions that were sensitive to the two types of processes: a block-level manipulation of encoding task that influenced subsequent memory, and a back-sort procedure. LIPC was sensitive to item- and task-level processing, but not in a way that always facilitates encoding. LIPC was more active for subsequently remembered words than subsequently forgotten words, but it was also more active in a task that emphasized task-level processing relative to a task that emphasized item-level processing, although this former condition led to poorer subsequent memory performance. This pattern indicates that processes subserved by LIPC are not always positively correlated with episodic encoding. Rather, LIPC processes can support both the controlled semantic processing of items and the controlled retrieval of relevant semantic task context. When devoted to the latter, the diversion of LIPC processes to the task level can have a negative consequence for item-level analysis and encoding.     

Activation of human hippocampal formation reflects success in both encoding and cued recall of paired associates

Contemporary theories of hippocampal function suggest that both encoding and retrieval of episodic memories may be accomplished by neural circuitry embedded within the same anatomical structures, but neuroimaging support for this hypothesis has been ambiguous. Recent studies suggest that the best available indicators of hippocampal encoding and retrieval operations are selective activations due to novelty, encoding success, and recall success in a paired associate learning paradigm. In the current study, both encoding and cued recall of paired associate words were conducted during a single session of fMRI scanning. Bilateral activation in the medial temporal lobe was detected for encoding word pairs vs. a fixation baseline and for encoding novel word pairs vs. repeated word pairs. These activations were stronger in subjects who successfully memorized more word pairs. In cued recall, greater responses were seen in higher performing subjects. In lower performing subjects, responses were greater to cue words whose paired associate was correctly recalled than to cue words whose correct associate had been forgotten (or not encoded). The difference between correct and incorrect trials was more pronounced on repeated presentations of the same cue words, but not apparent on their first presentation alone. Overlap of encoding and retrieval effects was maximal in the middle of the longitudinal extent of the right hippocampus, with one additional locus of overlap outside the MTL, in left occipitotemporal cortex. The conjunction of these effects suggests that it is correct to view both encoding and recall of associative memories as functions of an integrated hippocampal system.     

Putting names to faces: successful encoding of associative memories activates the anterior hippocampal formation

The ability to form associations between previously unrelated items of information, such as names and faces, is an essential aspect of episodic memory function. The neural substrate that determines success vs. failure in learning these associations remains to be elucidated. Using event-related functional MRI during the encoding of novel face-name associations, we found that successfully remembered face-name pairs showed significantly greater activation in the anterior hippocampal formation bilaterally and left inferior prefrontal cortex, compared to pairs that were forgotten. Functional connectivity analyses revealed significant correlated activity between the right and left hippocampus and neocortical regions during successful, but not attempted, encoding. These findings suggest that anterior regions of the hippocampal formation, in particular, are crucial for successful associative encoding and that the degree of coordination between hippocampal and neocortical activity may predict the likelihood of subsequent memory.     

Cerebellar contributions to episodic memory encoding as revealed by fMRI

Event-related functional Magnetic Resonance Imaging (fMRI) allows for the comparison of hemodynamic responses evoked by items that are remembered in a subsequent memory task vs. items that are forgotten. In this way, brain regions that assumingly contribute to successful memory encoding have been identified, including the left inferior prefrontal cortex (LIPC) and the medial temporal lobe. Although a cerebellar involvement in verbal working memory is well-established, a contribution of the cerebellum to episodic long-term encoding has only sporadically been described, and mechanisms underlying cerebellar memory effects are unclear. We conducted a typical incidental verbal memory fMRI experiment with three different encoding tasks varying the depth of semantic processing. Slice positioning allowed for the coverage of the entire cerebellum. We observed a significant subsequent memory effect within the superior and posterior right cerebellar hemisphere that was task independent. Additionally, we found a different area within the superior right cerebellum displaying a memory effect specifically for semantically processed words and a bilateral cerebellar activation specifically associated with encoding success only for a non-semantic task. Our results suggest that besides its known role in verbal working memory, the cerebellum contributes to episodic long-term encoding and should therefore be considered in future fMRI studies dealing with episodic memory.     

Recognition memory for studied words is determined by cortical activation differences at encoding but not during retrieval

Prior work has shown that when responses to incidentally encoded words are sorted, subsequently remembered words elicit greater left prefrontal BOLD signal change relative to forgotten words. Similarly, low-frequency words elicit greater activation than high-frequency words in the same left prefrontal regions, contributing to their better subsequent memorability. This study examined the relative contribution of encoding and retrieval processes to the correct recognition of target words. A mixture of high- and low-frequency words was incidentally encoded. Scanning was performed at encoding as well as during retrieval. During encoding, greater activation in the left prefrontal and anterior cingulate regions predicted a higher proportion of hits for low-frequency words. However, data acquired during recognition showed that word frequency did not modulate activation in any of the areas tracking successful recognition. This result demonstrates that under some circumstances, the recognition of studied words is determined purely by processes that are active during encoding. In contrast to the finding for hits, activation associated with correctly rejected foils was modulated by word frequency, being higher for high-frequency words in the left lateral parietal and anterior prefrontal regions. These findings were replicated in two further experiments, one in which the number of test items at recognition was doubled and another where encoding strength for high-frequency words was varied (once vs. 10 times). These results indicate that word frequency modulates activity in the left lateral parietal and anterior prefrontal regions contingent on whether the item involved is correctly recognized as a target or a foil. This observation is consistent with a dual process account of episodic memory.     

Brain mechanisms for mood congruent memory facilitation

Emotional information is better remembered when mood at the time of retrieval matches it in valence (positive mood, positive material). An associative memory model predicts that this 'mood congruent' facilitation is due to the mood-related reactivation at retrieval of emotional responses which were linked to valenced information at encoding. To test this model, we presented subjects with positive and negative words at study and manipulated their mood at test while using functional imaging to monitor brain activity. Subjective mood ratings and heart rate variability both indicated that the manipulation was effective, and memory performance showed a strong trend towards facilitation in congruent conditions. In the functional imaging data, valence-specific conjunctions between encoding activity predicting subsequent memory in a congruent mood and retrieval activity relating to mood congruent recollection revealed shared responses in subgenual cingulate for positive valence and posteriolateral orbitofrontal cortex for negative valence, thus supporting the associative model. To elucidate the mnemonic basis of facilitation, independent of valence, we examined the shared correlates of positive and negative congruence and found that parts of the episodic memory system were activated by congruence in correct rejection trials, but no part of this system was activated by congruence in correctly remembered trials. This pattern suggests that mood congruent facilitation occurs at the level of attempted recall rather than that of successful recollection.     

Preserved verbal memory function in left medial temporal pathology involves reorganisation of function to right medial temporal lobe

The left hippocampus and related structures mediate verbal memory function. The mechanism underlying preserved verbal memory function in patients with left hippocampal damage is unknown. Temporal lobe epilepsy, a common disease, is frequently the consequence of a characteristic hippocampal pathology termed hippocampal sclerosis, which may also affect the amygdala. In this setting, mapping the sites of memory function is a vital component of planning for surgical treatment for epilepsy. Using event-related functional magnetic resonance imaging, we studied 24 right-handed nonamnesic patients with left hippocampal sclerosis and 12 normal controls, performing a verbal encoding task. The patients were subdivided into two groups according to presence or absence of additional left amygdala pathology. Analysis of the data employed a two-level random-effects design, examining the main effects of subsequent memory in each group, as well as the differences between the groups. Additional effects of emotionality of the remembered words were also examined. Verbal memory encoding involved activation of left hippocampus in normals, but was associated with reorganisation to right hippocampus and parahippocampal gyrus in the patients. The additional presence of left amygdala sclerosis resulted in reorganisation for encoding of emotional verbal material to right amygdala. Retained verbal memory function in the presence of left medial temporal lobe pathology is mediated by recruitment of a parallel system in the right hemisphere consistent with adaptive functional reorganisation. The findings indicate a high degree of plasticity in medial temporal lobe structures.     

Left temporal and temporoparietal brain activity depends on depth of word encoding: a magnetoencephalographic study in healthy young subjects

Using a 143-channel whole-head magnetoencephalograph (MEG) we recorded the temporal changes of brain activity from 26 healthy young subjects (14 females) related to shallow perceptual and deep semantic word encoding. During subsequent recognition tests, the subjects had to recognize the previously encoded words which were interspersed with new words. The resulting mean memory performances across all subjects clearly mirrored the different levels of encoding. The grand averaged event-related fields (ERFs) associated with perceptual and semantic word encoding differed significantly between 200 and 550 ms after stimulus onset mainly over left superior temporal and left superior parietal sensors. Semantic encoding elicited higher brain activity than perceptual encoding. Source localization procedures revealed that neural populations of the left temporal and temporoparietal brain areas showed different activity strengths across the whole group of subjects depending on depth of word encoding. We suggest that the higher brain activity associated with deep encoding as compared to shallow encoding was due to the involvement of more neural systems during the processing of visually presented words. Deep encoding required more energy than shallow encoding but for all that led to a better memory performance.     

Probability effects on the neural correlates of retrieval success: an fMRI study

Event-related fMRI was employed to investigate the influence of the relative probability of old and new test items on the neural correlates of recognition memory. Twelve subjects undertook three study-test cycles, each consisting of an identical study phase in which a series of words was encoded in an incidental task, followed by a test phase in which yes/no recognition judgments were made to a mixture of studied (old) and unstudied (new) words. The ratio of old to new words differed in each test phase, and was either 25:75, 50:50, or 75:25. In lateral inferior and medial parietal cortex, and the posterior cingulate, greater activity was elicited by correctly classified old than new items independently of old:new ratio. By contrast, in other regions, including anterior, dorsolateral, and ventrolateral prefrontal cortex, differences in the activity elicited by old and new items varied according to old:new ratio, demonstrating in some cases a complete crossover interaction. The results suggest that differential activity elicited by old and new test items is likely to support successful recognition in only a subset of the regions identified in previous studies as exhibiting such differences. In other regions, most notably prefrontal cortex, differences in the activity elicited by old and new items appear to reflect processes that are contingent upon, rather than in support of, successful recognition.     

The effect of headache pain on attention (encoding) and memory (recognition)

Memory is a key cognitive variable in pain management. This study examined the effect of headaches on participants' encoding of words (attention) and later memory for words. The dependent measures were response time during encoding and recognition memory; headache pain was the independent measure. Eighty participants were randomized to one of four groups: two groups had the same condition (headache pain or no headache pain) for both the encoding and memory tasks and two groups had mixed conditions (i.e. pain during encoding/no pain during recognition; no pain during encoding/pain during recognition). Participants with pain during encoding judged words significantly slower (177.53ms) than participants without pain during encoding. Participants with pain during the memory task recognized significantly fewer words (5.4%) than participants without pain during the memory task, regardless of pain condition during encoding. Results from this and other pain and memory studies conducted in this laboratory suggest that pain, as it adversely affects memory, may operate at a threshold level rather than on a dose-response continuum.     

Electrical neuroimaging of memory discrimination based on single-trial multisensory learning

Multisensory experiences influence subsequent memory performance and brain responses. Studies have thus far concentrated on semantically congruent pairings, leaving unresolved the influence of stimulus pairing and memory sub-types. Here, we paired images with unique, meaningless sounds during a continuous recognition task to determine if purely episodic, single-trial multisensory experiences can incidentally impact subsequent visual object discrimination. Psychophysics and electrical neuroimaging analyses of visual evoked potentials (VEPs) compared responses to repeated images either paired or not with a meaningless sound during initial encounters. Recognition accuracy was significantly impaired for images initially presented as multisensory pairs and could not be explained in terms of differential attention or transfer of effects from encoding to retrieval. VEP modulations occurred at 100-130 ms and 270-310 ms and stemmed from topographic differences indicative of network configuration changes within the brain. Distributed source estimations localized the earlier effect to regions of the right posterior temporal gyrus (STG) and the later effect to regions of the middle temporal gyrus (MTG). Responses in these regions were stronger for images previously encountered as multisensory pairs. Only the later effect correlated with performance such that greater MTG activity in response to repeated visual stimuli was linked with greater performance decrements. The present findings suggest that brain networks involved in this discrimination may critically depend on whether multisensory events facilitate or impair later visual memory performance. More generally, the data support models whereby effects of multisensory interactions persist to incidentally affect subsequent behavior as well as visual processing during its initial stages.     

Oscillatory brain activity before and after an internal context change--evidence for a reset of encoding processes

Prior behavioral work has shown that changing context during encoding can influence long-term memory performance. The present study examined the neural correlates of such context effects by analyzing oscillatory brain activity during the encoding of words, both before and after a context change. Participants studied two lists of items and, after the presentation of List 1, were either cued to change their internal context through a simple imagination task, or not. Replicating the behavioral work, the change in context led to forgetting of the first list (List 1) and to memory enhancement of the second (List 2). Measuring EEGs during encoding of the two lists, the context change was found to affect oscillatory brain activity. Whereas an increase of theta and alpha power from List-1 to List-2 encoding was found when the context was left unchanged, a slight theta and alpha power decrease was found when the context was changed. In addition, median split analysis revealed that alpha power during List-2 encoding was related to the enhancement effect of the context change. The results suggest that a change in internal context can lead to a reset of encoding processes, thus pointing to a crucial role of encoding processes in context-dependent memory.     

Chronometry of word and picture identification: common and modality-specific effects

Based on a previous fMRI connectivity analysis, we previously proposed that long-distance connections between left inferior frontal sulcus and left occipitotemporal sulcus mediate access to visual short-term memory both for written words and pictures enhancing conscious perception and successful encoding in an amodal manner. Using a 64-channel event-related potential electrode system in 19 young cognitively intact volunteers, we determined the chronometry of common and input-modality specific effects of word and picture identification and subsequent memory retrieval. Stimulus durations were calibrated per subject, modality and run so as to reach a 50% positive identification report. The earliest main effect of a positive identification report occurred between 180 and 200 ms, was common for both input-modalities, had a positive polarity and was located at around CPz. This effect was followed between 270 and 450 ms by additional common positive-polarity effects at centrofrontal electrode sites and by common negative effects at P7/P8, TP7/TP8 and T8. Each of the later effects was closely associated not only with identification but also with subsequent memory retrieval. The earliest input-modality specific effect of conscious identification that we detected occurred from 280 till 440 ms at P8. Our findings are in line with a model where the initial stages of perceptual identification and visual short-term memory access rely on long-distance connections that are shared between written words and pictures.     

Oscillatory correlates of the primacy effect in episodic memory

Both intracranial and scalp EEG studies have demonstrated that oscillatory activity, especially in the gamma band (28 to 100 Hz), can differentiate successful and unsuccessful episodic encoding [Sederberg, P.B., Kahana, M.J., Howard, M.W., Donner, E.J., Madsen, J.R., 2003. Theta and gamma oscillations during encoding predict subsequent recall. Journal of Neuroscience, 23(34), 10809-10814; Fell, J., Klaver, P., Lehnertz, K., Grunwald, T., Schaller, C., Elger, C.E., Fernandez, G., 2001. Human memory formation is accompanied by rhinal-hippocampal coupling and decoupling. Nature Neuroscience, 4 (12), 1259-1264; Gruber, T., Tsivilis, D., Montaldi, D., and Müller, M. (2004). Induced gamma band responses: An early marker of memory encoding and retrieval. Neuroreport, 15, 1837-1841; Summerfield, C., Mangels, J.A., in press. Dissociable neural mechanisms for encoding predictable and unpredictable events. Journal of Cognitive Neuroscience]. Although the probability of recalling an item varies as a function of where it appeared in the list, the relation between the oscillatory dynamics of successful encoding and serial position remains unexplored. We recorded scalp EEG as participants studied lists of common nouns in a delayed free-recall task. Because early list items were recalled better than items from later serial positions (the primacy effect), we analyzed encoding-related changes in 2 to 100 Hz oscillatory power as a function of serial position. Increases in gamma power in posterior regions predicted successful encoding at early serial positions; widespread low-frequency (4-14 Hz) power decreases predicted successful memory formation for later serial positions. These results suggest that items in early serial positions receive an encoding boost due to focused encoding without having to divide resources among numerous list items. Later in the list, as memory load increases, encoding is divided between multiple items.     

When less means more: deactivations during encoding that predict subsequent memory

In event-related functional MRI (fMRI) studies, greater activity for items that are subsequently remembered (R-items) than for items that are subsequently forgotten (F-items), or Dm effect (Difference in memory), has been attributed to successful encoding operations. In contrast, regions showing a reverse DM effect (revDM = F-items > R-items) have been linked to detrimental processes leading to forgetting. Yet, revDMs may reflect not only activations for F-items (aFs) but also deactivations for R-items (dRs), and the latter alternative is more likely to reflect beneficial rather than detrimental encoding processes. To investigate this issue, we used a paradigm that included a fixation baseline and could distinguish between the two types of revDMs (aF vs. dR). Participants were scanned while encoding semantic associations between words or perceptual associations between words and fonts, and their memory was measured with associative recognition tests. For both semantic and perceptual encoding, dR effects were found in dorsolateral prefrontal, temporoparietal, and posterior midline regions. In contrast with a prior study that attributed revDMs in these regions to detrimental processes, the present results suggest that these effects reflect beneficial processes, that is, the efficient reallocation of neurocognitive resources. At the same time, aF effects were found in other regions, such as the insula, and these are more consistent with an interpretation in terms of detrimental processes. Whereas most fMRI studies of encoding have focused on activation increases, the present study indicates that activation decreases are also critical for successful learning of new information.     

Neural correlates of verbal associative memory and mnemonic strategy use following childhood traumatic brain injury

Children with traumatic brain injury (TBI) often experience memory deficits, although the nature, functional implication, and recovery trajectory of such difficulties are poorly understood. The present fMRI study examined the neural activation patterns in a group of young children who sustained moderate TBI in early childhood (n = 7), and a group of healthy control children (n = 13) during a verbal paired associate learning (PAL) task that promoted the use of two mnemonic strategies differing in efficacy. The children with TBI demonstrated intact memory performance and were able to successfully utilize the mnemonic strategies. However, the TBI group also demonstrated altered brain activation patterns during the task compared to the control children. These findings suggest early childhood TBI may alter activation within the network of brain regions supporting associative memory even in children who show good behavioral performance.