The perceptual richness of complex memory episodes is compromised by medial temporal lobe damage

Perceptual richness, a defining feature of episodic memory, emerges from the reliving of multimodal sensory experiences. Although the importance of the medial temporal lobe (MTL) to episodic memory retrieval is well documented, the features that determine its engagement are not well characterized. The current study assessed the relationship between MTL function and episodic memory's perceptual richness. We designed a laboratory memory task meant to capture the complexity of memory for life episodes, while manipulating memory's perceptual content. Participants encoded laboratory episodes with rich (film clips) and impoverished (written narratives) perceptual content that were matched for other characteristics such as personal significance, emotionality and story content. At retrieval, participants were probed to describe the stories' perceptual features and storyline. Participants also recalled autobiographical memories (AMs) in a comparison condition. We compared the performance of patients with unilateral medial temporal lobe epilepsy (mTLE) and healthy controls to assess how damage to the MTL affects retrieval in these conditions. We observed an overall decrease in detail count in the mTLE group, along with a disproportionate deficit in perceptual details that was most acute in the AM and the perceptually enriched film clip conditions. Our results suggest that the impaired sense of reliving the past that accompanies MTL insult is mediated by a paucity of perceptual episodic memory details. We also introduce a new protocol that successfully mimics naturalistic memories while benefiting from the experimental control provided by using laboratory stimuli. © 2014 Wiley Periodicals, Inc.     

The medial temporal lobes distinguish between within‐item and item‐context relations during autobiographical memory retrieval

During autobiographical memory retrieval, the medial temporal lobes (MTL) relate together multiple event elements, including object (within‐item relations) and context (item‐context relations) information, to create a cohesive memory. There is consistent support for a functional specialization within the MTL according to these relational processes, much of which comes from recognition memory experiments. In this study, we compared brain activation patterns associated with retrieving within‐item relations (i.e., associating conceptual and sensory‐perceptual object features) and item‐context relations (i.e., spatial relations among objects) with respect to naturalistic autobiographical retrieval. We developed a novel paradigm that cued participants to retrieve information about past autobiographical events, non‐episodic within‐item relations, and non‐episodic item‐context relations with the perceptuomotor aspects of retrieval equated across these conditions. We used multivariate analysis techniques to extract common and distinct patterns of activity among these conditions within the MTL and across the whole brain, both in terms of spatial and temporal patterns of activity. The anterior MTL (perirhinal cortex and anterior hippocampus) was preferentially recruited for generating within‐item relations later in retrieval whereas the posterior MTL (posterior parahippocampal cortex and posterior hippocampus) was preferentially recruited for generating item‐context relations across the retrieval phase. These findings provide novel evidence for functional specialization within the MTL with respect to naturalistic memory retrieval. © 2015 Wiley Periodicals, Inc.     

Medial temporal lobe structures are needed to re-experience remote autobiographical memories: evidence from H.M. and W.R

The nature and extent of retrograde amnesia in patients with medial temporal lobe (MTL) lesions is currently under debate. While some investigators propose a temporally limited role for the MTL in episodic and semantic memory, others claim that MTL structures are needed for episodic memories of one's entire lifetime, and that only semantic memory becomes independent of the MTL. To address this issue, we tested two amnesic patients, H.M. and W.R., with bilateral MTL lesions on a series of remote memory tests that together distinguished episodic memory from semantic memory performance. Notably, we used a new method to assess autobiographical memory that measured the degree of re-experiencing of personal happenings from the past. Both patients showed relatively spared semantic memory, but severe impairment on measures of autobiographical memory, with no temporal gradient. Our data support the view that MTL structures play a significant role in recalling specific personal episodes, not only from the recent past but from the distant past as well.     

Insights from semantic dementia on the relationship between episodic and semantic memory

An influential theory of long-term memory, in which new episodic learning is dependent upon the integrity of semantic memory, predicts that a double dissociation between episodic and semantic memory is not possible in new learning. Contrary to this view, we found, in two separate experiments, that patients with impaired semantic memory showed relatively preserved performance on tests of recognition memory if the stimuli were perceptually identical between learning and test. A significant effect of semantic memory was only seen when a perceptual manipulation was introduced in the episodic task. To account for these findings, we propose a revision to current models of long-term memory, in which sensory/perceptual information and semantic memory work in concert to support new learning.     

Functional dissociation of hippocampal mechanism during implicit learning based on the domain of associations

Traditionally, the medial temporal lobe (MTL) was linked to explicit or declarative memory in associative learning. However, recent studies have reported MTL involvement even when volunteers are not consciously aware of the learned contingencies. Therefore, the mechanism of the MTL-related learning process cannot be described sufficiently by the explicit/implicit distinction, and the underlying process in the MTL for associative learning needs a more functional characterization. A possible feature that would allow a functional specification also for implicit learning is the nature of the material that is learned. Given that implicit memory tasks often comprise a combination of perceptual and motor learning, we hypothesized that implicit learning of the perceptual but not the motor component entails MTL activation in these studies. To directly test this hypothesis, we designed a purely perceptual and a purely motor variant of the serial reaction time task. In two groups of human volunteers, behavioral results clearly showed that both variants were learned without awareness. Neuronal recordings using fMRI revealed that bilateral hippocampal activation was observed only for implicit learning of the perceptual sequence, not for the motor sequence. This dissociation clearly shows that the functional role of the hippocampus for learning is determined by the domain of the learned association and that the function of the medial temporal lobe system is the processing of contingencies between perceptual features regardless of the explicit or implicit nature of the ensuing memory.     

Differential sex effects in olfactory functioning: the role of verbal processing.

We investigated sex difference across a number of olfactory tasks. Thirty-six men and 35 women ranging in age from 19 to 36 years were assessed in 6 different tasks: absolute sensitivity for n-butanol, intensity discrimination, quality discrimination, episodic recognition memory for familiar and unfamiliar odors, and odor identification. No sex differences were observed in the tasks tapping primarily sensory acuity (i.e., odor sensitivity, intensity discrimination, and quality discrimination) or in episodic memory for unfamiliar odors. By contrast, women outperformed men in the tasks involving verbal processing (i.e., memory for familiar odors and odor identification). Interestingly, controlling for odor naming ability resulted in that the observed sex difference in episodic odor memory for familiar odors disappeared. This outcome suggests that women's superiority in episodic odor memory is largely mediated by their higher proficiency in odor identification.     

Perceptual deficits in amnesia: challenging the medial temporal lobe 'mnemonic' view

Recent animal studies suggest that the medial temporal lobe (MTL), which is thought to subserve memory exclusively, may support non-mnemonic perceptual processes, with the hippocampus and perirhinal cortex contributing to spatial and object perception, respectively. There is, however, no support for this view in humans, with human MTL lesions causing prominent memory deficits in the context of apparently normal perception. We assessed visual discrimination in amnesic cases to reveal that while selective hippocampal damaged patients could discriminate faces, objects, abstract art and colour, they were significantly poorer in discriminating spatial scenes. By contrast, patients with MTL damage, including perirhinal cortex, were significantly impaired in discriminating scenes, faces, and to a lesser extent objects, with relatively intact discrimination of art and colour. These novel observations imply that the human MTL subserves both perceptual and mnemonic functions, with the hippocampus and perirhinal cortex playing distinct roles in spatial and object discrimination, respectively.     

Retrieval of autobiographical memory in Alzheimer's disease: relation to volumes of medial temporal lobe and other structures

The representation of autobiographical memory is distributed over a network of brain structures, with the medial temporal lobe (MTL) at its epicenter. Some believe that, over time, all memories become independent of their MTL component ("consolidation theories"). Others have suggested that this is true only of semantic memory, while episodic aspects of autobiographical memories are dependent on the MTL for as long as they exist, such as multiple trace theory (MTT). In the present study, the volumes of 28 brain regions, including the MTL, and their relation to autobiographical memory were investigated in a group of patients with Alzheimer's disease with varying degrees of retrograde memory loss as assessed by the Autobiographical Memory Interview (AMI). We used the multivariate analysis method of partial least squares (PLS) to assess patterns of atrophy that can lead to retrograde amnesia. We found that different aspects of autobiographical memory were associated with different patterns of tissue loss. Personal semantics were related to a pattern of bilateral anterior and posterior lateral temporal cortex degeneration, more pronounced on the left, as well as right frontal degeneration. Autobiographical event memory ("episodic") was associated with combined atrophy in bilateral MTL and anterior lateral temporal neocortex, more pronounced on the right. This pattern was invariant for memories from childhood, early adulthood, and recent memories, in line with the predictions of MTT, suggesting that MTL tissue is crucial for retrieval of episodic memories regardless of their age.     

Going beyond LTM in the MTL: A synthesis of neuropsychological and neuroimaging findings on the role of the medial temporal lobe in memory and perception

Studies in rats and non-human primates suggest that medial temporal lobe (MTL) structures play a role in perceptual processing, with the hippocampus necessary for spatial discrimination, and the perirhinal cortex for object discrimination. Until recently, there was little convergent evidence for analogous functional specialisation in humans, or for a role of the MTL in processes beyond long-term memory. A recent series of novel human neuropsychological studies, however, in which paradigms from the animal literature were adapted and extended, have revealed findings remarkably similar to those seen in rats and monkeys. These experiments have demonstrated differential effects of distinct stimulus categories on performance in tasks for which there was no explicit requirement to remember information across trials. There is also accruing complementary evidence from functional neuroimaging that MTL structures show differential patterns of activation for scenes and objects, even on simple visual discrimination tasks. This article reviews some of these key studies and discusses the implications of these new findings for existing accounts of memory. A non-modular view of memory is proposed in which memory and perception depend upon the same anatomically distributed representations (emergent memory account). The limitations and criticisms of this theory are discussed and a number of outstanding questions proposed, including key predictions that can be tested by future studies.     

Patterns of autobiographical memory loss in medial-temporal lobe amnesic patients

The issue of whether the hippocampus and related structures in the medial-temporal lobe (MTL) play a temporary or permanent role in autobiographical episodic memory remains unresolved. One long-standing belief is that autobiographical memory (AM), like semantic memory, is initially dependent on the MTL but ultimately can be retained and recovered independently of it. However, evidence that hippocampal amnesia results in severe loss of episodic memory for a lifetime of personally experienced events suggests otherwise. To test the opposing views, we conducted detailed investigations of autobiographical episodic memory in people with amnesia resulting from MTL lesions of varying extent. By combining precise quantification of MTL and neocortical volumes with sensitive measures of recollection of one's personal past, we show that the severity of episodic, but not semantic, AM loss is best accounted for by the degree of hippocampal damage and less likely related to additional neocortical compromise.     

Medial temporal lobe structure and cognition in individuals with schizophrenia and in their non-psychotic siblings

Medial temporal lobe (MTL) structures play a central role in episodic memory. Prior studies suggest that individuals with schizophrenia have deficits in episodic memory as well as structural abnormalities of the medial temporal lobe (MTL). While correlations have been reported between MTL volume loss and episodic memory deficits in such individuals, it is not clear whether such correlations reflect the influence of the disease state or of underlying genetic influences that might contribute to risk. We used high resolution magnetic resonance imaging and probabilistic algorithms for image analysis to determine whether MTL structure, episodic memory performance and the relationship between the two differed among groups of 47 healthy control subjects, 50 control siblings, 39 schizophrenia subjects, and 33 siblings of schizophrenia subjects. High-dimensional large deformation brain mapping was used to obtain volume measures of the hippocampus. Cortical distance mapping was used to obtain volume and thickness measures of the parahippocampal gyrus (PHG) and its substructures: the entorhinal cortex (ERC), the perirhinal cortex (PRC), and the parahippocampal cortex (PHC). Neuropsychological data was used to establish an episodic memory domain score for each subject. Both schizophrenia subjects and their siblings displayed abnormalities in episodic memory performance. Siblings of individuals with schizophrenia, and to a lesser extent, individuals with schizophrenia themselves, displayed abnormalities in measures of MTL structure (volume loss or cortical thinning) as compared to control groups. Further, we observed correlations between structural measures and memory performance in both schizophrenia subjects and their siblings, but not in their respective control groups. These findings suggest that disease-specific genetic factors present in both patients and their relatives may be responsible for correlated abnormalities of MTL structure and memory impairment. The observed attenuated effect of such factors on MTL structure in individuals with schizophrenia may be due to non-genetic influences related to the development and progression of the disease on global brain structure and cognitive processing.     

Associative fear learning and perceptual discrimination: A perceptual pathway in the development of chronic pain

Recent neuropsychological theories emphasize the influence of maladaptive learning and memory processes on pain perception. However, the precise relationship between these processes as well as the underlying mechanisms remain poorly understood; especially the role of perceptual discrimination and its modulation by associative fear learning has received little attention so far. Experimental work with exteroceptive stimuli consistently points to effects of fear learning on perceptual discrimination acuity. In addition, clinical observations have revealed that in individuals with chronic pain perceptual discrimination is impaired, and that tactile discrimination training reduces pain. Based on these findings, we present a theoretical model of which the central tenet is that associative fear learning contributes to the development of chronic pain through impaired interoceptive and proprioceptive discrimination acuity.     

Episodic memory--from brain to mind

Neuronal mechanisms of episodic memory, the conscious recollection of autobiographical events, are largely unknown because electrophysiological studies in humans are conducted only in exceptional circumstances. Unit recording studies in animals are thus crucial for understanding the neurophysiological substrate that enables people to remember their individual past. Two features of episodic memory--autonoetic consciousness, the self-aware ability to "travel through time", and one-trial learning, the acquisition of information in one occurrence of the event--raise important questions about the validity of animal models and the ability of unit recording studies to capture essential aspects of memory for episodes. We argue that autonoetic experience is a feature of human consciousness rather than an obligatory aspect of memory for episodes, and that episodic memory is reconstructive and thus its key features can be modeled in animal behavioral tasks that do not involve either autonoetic consciousness or one-trial learning. We propose that the most powerful strategy for investigating neurophysiological mechanisms of episodic memory entails recording unit activity in brain areas homologous to those required for episodic memory in humans (e.g., hippocampus and prefrontal cortex) as animals perform tasks with explicitly defined episodic-like aspects. Within this framework, empirical data suggest that the basic structure of episodic memory is a temporally extended representation that distinguishes the beginning from the end of an event. Future research is needed to fully understand how neural encodings of context, sequences of items/events, and goals are integrated within mnemonic representations of autobiographical events.     

Feature binding in perceptual priming and in episodic object recognition: evidence from event-related brain potentials

It is argued that explicit remembering is based on so-called episodic tokens binding together all perceptual features of a visual object. In episodic recognition, these features are collectively reactivated. In support of this view, it has been shown that changing sensory features of a stimulus from study to test decreases subject's performance in an episodic recognition task, even though the changed features are irrelevant for the recognition judgment. On the other hand, repetition priming is unaffected by such manipulations of perceptual specificity. Implicit memory performance is therefore thought to depend on structural representations, so-called types, comprising only invariant perceptual features, but no exemplar-specific details. Event-related potentials (ERPs) in our study revealed electrophysiological evidence for the differential involvement of these perceptual memory traces in explicit and implicit memory tasks. Participants attended either a living-nonliving task or an episodic recognition task with visually presented objects. During test both groups of participants processed new objects and old objects, which were repeated either identically or in a mirror-reversed version. In the implicit task ERPs showed an occipitoparietal repetition effect, which was the same for identically repeated items and mirror reversals. In contrast, in the explicit task an early mid-frontal old/new effect for identical but not for mirror-reversed old objects was observed indicating involuntary access to perceptual information during episodic retrieval. A later portion of the old/new effect solely differentiated both types of old items from new ones.     

Representational demands modulate involvement of perirhinal cortex in face processing

The classic view holds that the medial temporal lobes (MTL) are dedicated to declarative memory functioning. Recent evidence, however, suggests that perirhinal cortex (PrC), a structure within the anterior MTL, may also play a role in perceptual discriminations when representations of complex conjunctions of features, or of gestalt‐characteristics of objects must be generated. Interestingly, neuroimaging and electrophysiological recordings in nonhuman primates have also revealed a face patch in the anterior collateral sulcus with preferential responses to face stimuli in various task contexts. In the present fMRI study, we investigated the representational demands that influence PrC involvement in different types of judgments on human faces. Holding stimulus complexity constant, we independently manipulated the nature of the task and the orientation of the stimuli presented (through face inversion). Aspects of right PrC showed increased responses in a forced‐choice recognition‐memory and a perceptual‐oddity task, as compared to a feature‐search task that was included to probe visual detection of an isolated face feature. Effects of stimulus orientation in right PrC were observed when the recognition‐memory condition for upright faces was compared with all other experimental conditions, including recognition‐memory for inverted faces‐a result that can be related to past work on the role of PrC in object unitization. Notably, both effects in right PrC paralleled activity patterns in broader networks of regions that also included the right fusiform gyrus and the amygdala, regions frequently implicated in face processing in prior research. As such, the current findings do not support the view that reference to a prior study episode clearly distinguishes the role of PrC from that of more posterior ventral visual pathway regions. They add to a growing body of evidence suggesting that the functional role of specific MTL structures may be best understood in terms of the representations that are required by the task and the stimuli at hand. © 2013 Wiley Periodicals, Inc.     

Perception and conception: temporal lobe activity during complex discriminations of familiar and novel faces and objects

Recent studies indicate that medial-temporal lobe (MTL) damage, either from focal lesions or neurodegenerative disease (e.g., semantic dementia), impairs perception as well as long-term declarative memory. Notably, however, these two patient groups show different performance for meaningful versus unfamiliar stimuli. In amnesics with nonprogressive MTL lesions, the use of meaningful stimuli, compared with unfamiliar items, boosted discrimination performance. In semantic dementia, a condition characterized by progressive deterioration of conceptual knowledge in the context of anterolateral temporal lobe damage, performance for meaningful stimuli was equivalent to that for unfamiliar items. To further investigate these findings, we scanned healthy volunteers while they performed odd-one-out discriminations involving familiar (i.e., meaningful/famous) and unfamiliar (i.e., novel) objects and faces and a baseline task of size oddity. Outside the scanner, volunteers' recognition memory was assessed. We found above baseline activity in the perirhinal cortex and hippocampus for all object and face discriminations and above baseline activity in the temporal pole for all face discriminations. The comparison of meaningful, relative to novel, faces and objects, revealed increased activity in the perirhinal cortex and hippocampus. In the temporal pole, we also found activity related to meaningfulness for faces but not for objects. Importantly, these meaningfulness effects were evident even for discriminations that were not subsequently well remembered, suggesting that the difference between meaningful and novel stimuli reflects perceptual or conceptual processes rather than solely incidental encoding into long-term memory. The results provide further evidence that the MTL is recruited during complex perceptual discrimination and additionally suggest that these structures are recruited in semantic processing of objects and faces.     

Structural and functional correlates of behavioral pattern separation in the hippocampus and medial temporal lobe

Structures of the medial temporal lobe (MTL) are known to be involved in declarative memory processes. However, little is known about how age‐related changes in MTL structures, white matter integrity, and functional connectivity affect pattern separation processes in the MTL. In this study, we used magnetic resonance imaging (MRI) to measure the volumes of MTL regions of interest, including hippocampal subfields (dentate gyrus, CA3, CA1, and subiculum) in healthy older and younger adults. Additionally, we used diffusion tensor imaging to measure white matter integrity for both groups. Finally, we used functional MRI to acquire resting functional connectivity measures for both groups. We show that, along with age, the volume of left CA3/dentate gyrus predicts memory performance. Differences in fractional anisotropy and the strength of resting functional connections between the hippocampus and other cortical structures implicated in memory processing were not significant predictors of performance. As previous studies have only hinted, it seems that the size of left CA3/dentate gyrus contributes more to successful discrimination between similar mnemonic representations than other hippocampal sub‐fields, MTL structures, and other neuroimaging correlates. Accordingly, the implications of aging and atrophy on lure discrimination capacities are discussed. © 2014 Wiley Periodicals, Inc.     

Medial temporal lobe activity during semantic classification using a flexible fMRI design

In this study, we evaluated the use of a self-paced fMRI design, to allow a flexible speed of responding with only four alternating stimulus blocks to minimize the influence of task switching on a group of young subjects. This was done in view of our intention to use such a design on groups of elderly and demented subjects in the near future. In addition, the hypothesis was tested that the medial temporal lobe is involved in semantic memory similar to episodic memory using a semantic retrieval task. In line with previous imaging studies that compared a semantic (living/nonliving) to a perceptual (alphabetically ascending/descending) classification condition, activity was seen in lateral temporal and inferior frontal regions, indicating the applicability of our design. Additional activity was seen in the right, and, at a slightly lower threshold, also in the left MTL, providing support for the involvement of the MTL in retrieval from semantic memory.     

Increased local synchronization of resting-state fMRI signal after episodic memory encoding reflects off-line memory consolidation

The changes of spontaneous activity from before and after a memory or learning task had been considered to be related to off-line memory consolidation process in human brain by using resting-state functional connectivity (RSFC) MRI (fMRI). However, RSFC reflects temporal synchronization of timecourses of spatially distinct brain regions and therefore could not determine which specific brain region is involved in the memory consolidation process. Here we used regional homogeneity (ReHo), a method for measuring local synchronization, to link the local spontaneous activity change to off-line episodic memory consolidation. We hypothesized that the spontaneous activity change would be different between people with better memory performance and those with worse performance in memory-related regions. All participants completed two resting-state sessions, that is, before (REST-1) and after (REST-2) an episodic memory encoding task (picture indoor or outdoor judgment). Then, based on the d' of a later surprise memory retrieval test, a high-performance group and a low-performance group, each consisting of 16 participants, were chosen from whole 58 participants. We defined a ReHo ratio, that is, ReHo of REST-2 divided by ReHo of REST-1, as a change induced by memory consolidation. The high-performance group showed a significant higher ReHo ratio than low-performance group in medial temporal lobe (MTL) including parahippocampal and anterior temporal regions. The current results provide neuroimaging evidence supporting that the MTL is involved in off-line memory consolidation of episodic memory. Moreover, this study may provide a paradigm for understanding of episodic memory deficit in Alzheimer's disease.     

It does not look odd to me: Perceptual impairments and eye movements in amnesic patients with medial temporal lobe damage

Studies of people with memory impairments have shown that a specific set of brain structures in the medial temporal lobe (MTL) is vital for memory function. However, whether these structures have a role outside of memory remains contentious. Recent studies of amnesic patients with damage to two structures within the MTL, the hippocampus and the perirhinal cortex, indicated that these patients also performed poorly on perceptual tasks. More specifically, they performed worse than controls when discriminating between objects, faces and scenes with overlapping features. In order to investigate whether these perceptual deficits are reflected in their viewing strategies, we tested a group of amnesic patients with MTL damage that included the hippocampus and perirhinal cortex on a series of oddity discrimination tasks in which they had to select an odd item from a visual array. Participants' eye movements were monitored throughout the experiment. Results revealed that patients were impaired on tasks that required them to discriminate between items that shared many features, and tasks that required processing items from different viewpoints. An analysis of their eye movements revealed that they exhibited a similar viewing pattern as controls: they fixated more on the target item on trials answered correctly, but not on trials answered incorrectly. In addition, their impaired performance was not explained by an abnormal viewing-strategy that assessed their use of working memory. These results suggest that the perceptual deficits in the MTL patients are not a consequence of abnormal viewing patterns of the objects and scenes, but instead, could involve an inability to bind information gathered from several fixations into a cohesive percept. These data also support the view that MTL structures are important not only for long-term memory, but are also involved in perceptual tasks.