Activity in face-responsive brain regions is modulated by invisible, attended faces: evidence from masked priming

It is often assumed that neural activity in face-responsive regions of primate cortex correlates with conscious perception of faces. However, whether such activity occurs without awareness is still debated. Using functional magnetic resonance imaging (fMRI) in conjunction with a novel masked face priming paradigm, we observed neural modulations that could not be attributed to perceptual awareness. More specifically, we found reduced activity in several classic face-processing regions, including the "fusiform face area," "occipital face area," and superior temporal sulcus, when a face was preceded by a briefly flashed image of the same face, relative to a different face, even when 2 images of the same face differed. Importantly, unlike most previous studies, which have minimized awareness by using conditions of inattention, the present results occurred when the stimuli (the primes) were attended. By contrast, when primes were perceived consciously, in a long-lag priming paradigm, we found repetition-related activity increases in additional frontal and parietal regions. These data not only demonstrate that fMRI activity in face-responsive regions can be modulated independently of perceptual awareness, but also document where such subliminal face-processing occurs (i.e., restricted to face-responsive regions of occipital and temporal cortex) and to what extent (i.e., independent of the specific image).     

Domain-general and domain-sensitive prefrontal mechanisms for recollecting events and detecting novelty

Recollecting the past and discriminating novel from familiar memoranda depend on poorly understood prefrontal cortical (PFC) mechanisms hypothesized to vary according to memory task (e.g. recollection versus novelty detection) and domain of targeted memories (e.g. perceptual versus conceptual). Using event-related fMRI, we demonstrate that recollecting conceptual or perceptual details surrounding object encounters similarly recruits left frontopolar and posterior PFC compared with detecting novel stimuli, suggesting that a domain-general control network is engaged during contextual remembering. In contrast, left anterior ventrolateral PFC coactivated with a left middle temporal region associated with semantic representation, and right ventrolateral PFC with bilateral occipito-temporal cortices associated with representing object form, depending on whether recollections were conceptual or perceptual. These PFC/posterior cortical dissociations suggest that during recollection, lateralized ventrolateral PFC mechanisms bias posterior conceptual or perceptual feature representations as a function of memory relevance, potentially improving the gain of bottom-up memory signals. Supporting this domain-sensitive biasing hypothesis, novelty detection also recruited right ventrolateral PFC and bilateral occipito-temporal cortices compared with conceptual recollection, suggesting that searching for novel objects heavily relies upon perceptual feature processing. Collectively, these data isolate task- from domain-sensitive PFC control processes strategically recruited in the service of episodic memory.     

Working memory of auditory localization

To investigate brain mechanisms of sound location memory, we studied the distribution of brain activation with functional magnetic resonance imaging (fMRI) in subjects performing an audiospatial n-back task with three memory load levels. Working memory processing of audiospatial information activated areas in the superior, middle and inferior frontal gyri, and in the posterior parietal and middle temporal cortices. In a control experiment, fMRI during audio- and visuospatial 2-back task performances revealed only few differentially activated subregions between the two tasks. These results demonstrate that working memory processing of auditory locations involves a distributed network of brain areas and suggest that mnemonic processing of audio- and visuospatial information is directed along a common neural pathway in the posterior parietal and prefrontal cortices.     

Changes in connectivity profiles as a mechanism for strategic control over interfering subliminal information

Human behavior can be influenced by information that is not consciously perceived. Recent behavioral and electrophysiological evidence suggests, however, that the processing of subliminal stimuli is not completely beyond an observer's conscious control. The present study aimed to characterize the cortical network that implements strategic control over interfering subliminal information at multiple stages. Fourteen participants underwent functional magnetic resonance imaging (fMRI) scanning while performing a metacontrast masking paradigm. We systematically varied the amount of conflicting versus non-conflicting trials across experimental blocks, and behavioral performance demonstrated strategic effects whenever a high proportion of subliminal prime stimuli induced response competition. A psychophysiological interaction analysis revealed the pre-supplementary motor area (pre-SMA) to exhibit context-dependent covariation with activation in the lateral occipital complex (LOC) and the putamen. The pre-SMA thereby appears to fulfill a superordinate function in the control of processing subliminal information by simultaneously modulating perceptual analysis and motor selection.     

Electrophysiological and haemodynamic correlates of face perception,recognition and priming

Face perception, recognition and priming were examined with event-related functional magnetic resonance imaging (fMRI) and scalp event-related potentials (ERPs). Face perception was associated with haemodynamic increases in regions including bilateral fusiform and right superior temporal cortices, and a right posterior negativity (N170), most likely generated in the superior temporal region. Face recognition was associated with haemodynamic increases in fusiform, medial frontal and orbitofrontal cortices, and with a frontocentral positivity from 550 ms poststimulus. Face repetition was associated with a positivity from 400 to 600 ms and behavioural priming. Repetition of familiar faces was also associated with earlier onset of the ERP familiarity effect, and haemodynamic decreases in fusiform cortex. These data support a multi-component model of face-processing, with priming arising from more than one stage.     

The neural correlates of conscious vision

Conflicting accounts of the neurobiology of consciousness have emerged from previous imaging studies. Some studies suggest that visual consciousness relates to a distributed network of frontal and partietal regions while others point to localized activity within individual visual areas. While the two positions seem mutually exclusive, timing issues may help reconcile the two. Networks that appear unified in functional magnetic resonance imaging (fMRI) studies may reflect processes that are widely distributed in time. To help resolve this issue, we have investigated timing across a network correlating with consciousness in parallel fMRI and evoked potential (EP) studies of grating stimuli. At threshold, a stimulus is perceived on some occasions but not on others, dissociating sensory input and perception. We have found correlates of consciousness in the occipital lobe at 100 ms and in parietal, frontal, auditory and motor regions from 260 ms onwards. The broad temporal and spatial distribution of activity argues against a unified, distributed fronto-parietal correlate of consciousness. Instead, it suggests that correlates of consciousness are divided into primary and secondary network nodes, with early activity in the occipital lobe correlating with perception and later activity in downstream areas with secondary processes contingent on the outcome of earlier perceptual processing.     

The neural basis of visual skill learning: an fMRI study of mirror reading

The learning of perceptual skills is thought to rely upon multiple regions in the cerebral cortex, but imaging studies have not yet provided evidence about the changes in neural activity that accompany visual skill learning. Functional magnetic resonance imaging (fMRI) was used to examine changes in activation of posterior brain regions associated with the acquisition of mirror-reading skill for novel and practiced stimuli. Multiple regions in the occipital lobe, inferior temporal cortex, superior parietal cortex and cerebellum were involved in the reading of mirror-reversed compared to normally oriented text. For novel stimuli, skilled mirror-reading was associated with decreased activation in the right superior parietal cortex and posterior occipital regions and increased activation in the left inferior temporal lobe. These results suggest that learning to read mirror- reversed text involves a progression from visuospatial transformation to direct recognition of transformed letters. Reading practiced, relative to unpracticed, stimuli was associated with decreased activation in occipital visual cortices, inferior temporal cortex and superior parietal cortex and increased activation in occipito-parietal and lateral temporal regions. By examining skill learning and item- specific repetition priming in the same task, this study demonstrates that both of these forms of learning exhibit shifts in the set of neural structures that contribute to performance.      

Priming effects in the fusiform gyrus: changes in neural activity beyond the second presentation

Repetition priming typically leads to a decrease in the activation of sensory cortical areas upon a second exposure to the same visual stimulus. This effect is thought to reflect more efficient or fluent re-processing of previously seen stimuli so that less neural activity is required. Fluent re-processing has been hypothesized to be a potential link from repetition priming to neural changes associated with visual expertise. To examine this potential connection, the neural correlates of priming were examined across eight stimulus repetitions using functional magnetic resonance imaging. Sizeable regions of bilateral ventral occipito-temporal cortex (including the fusiform gyrus) exhibited reduced responses to the second presentation of a stimulus. Most of these areas displayed no further reduction in response to subsequent repetitions of the same stimuli. Because expertise accrues over many exposures, these areas, while clearly involved in priming, do not exhibit an activity pattern consistent with the development of expertise. In contrast, an area in the right posterior fusiform gyrus exhibited reductions in evoked response that grew in magnitude for stimulus repetitions from the second to the eighth presentations. This region exhibits a pattern of activity consistent with a gradual and cumulative enhancement of the fluency effect across trials, suggesting that it may mediate the link between priming and the development of visual expertise.     

Changes of cortico-striatal effective connectivity during visuomotor learning

It has been suggested that the cortico-striatal system might play a crucial role in learning behavioural plans of action. We have tested this hypothesis by studying the dynamics of functional coupling among the neural elements of cortico-striatal circuitry. Human cerebral activity was measured with functional magnetic resonance imaging (fMRI) during the learning of an associative visuomotor task. Structural equation modelling of regional fMRI time-series was used to characterize learning-related changes in effective connectivity. We report that learning to associate visual instructions with motor responses significantly altered cortico-striatal functional couplings. Specific learning-related increases of effective connectivity were found in temporo-striatal and fronto-striatal circuits. Connectivity among portions of the frontal cortex decreased as a function of learning. Temporo-frontal and parieto-frontal couplings were not altered during learning. We infer that novel visuomotor associations are established through the enhancement of specific cortico-striatal circuits, rather than through the alteration of direct temporo-frontal or parieto-frontal connectivity.     

Modulation of neural activity during object naming: effects of time and practice

Repeated exposure to objects improves our ability to identify and name them, even after a long delay. Previous brain imaging studies have demonstrated that this experience-related facilitation of object naming is associated with neural changes in distinct brain regions. We used event-related functional magnetic resonance imaging (fMRI) to examine the modulation of neural activity in the object naming system as a function of experience and time. Pictures of common objects were presented repeatedly for naming at different time intervals (1 h, 6 h and 3 days) before scanning, or at 30 s intervals during scanning. The results revealed that as objects became more familiar with experience, activity in occipitotemporal and left inferior frontal regions decreased while activity in the left insula and basal ganglia increased. In posterior regions, reductions in activity as a result of multiple repetitions did not interact with time, whereas in left inferior frontal cortex larger decreases were observed when repetitions were spaced out over time. This differential modulation of activity in distinct brain regions provides support for the idea that long-lasting object priming is mediated by two neural mechanisms. The first mechanism may involve changes in object-specific representations in occipitotemporal cortices, the second may be a form of procedural learning involving a reorganization in brain circuitry that leads to more efficient name retrieval.     

Hippocampal and neocortical gamma oscillations predict memory formation in humans

Functional magnetic resonance imaging (fMRI) of the human brain has shown that the hippocampus and the left temporal and frontal cortices play a key role in the formation of new verbal memories. We recorded electrical activity from 2349 surgically implanted intracranial electrodes in epilepsy patients while they studied and later recalled lists of common words. Using these recordings, we demonstrate that gamma oscillations (44-64 Hz) in the hippocampus and the left temporal and frontal cortices predict successful encoding of new verbal memories. This increase in gamma oscillations was not seen in other frequency bands, whose activity generally decreased during successful memory formation. These findings identify a role for gamma oscillations in verbal memory formation with the hippocampus and the left temporal and frontal cortices, the same regions implicated using noninvasive fMRI recording methods.     

Brain activity related to working memory and distraction in children and adults

In order to retain information in working memory (WM) during a delay, distracting stimuli must be ignored. This important ability improves during childhood, but the neural basis for this development is not known. We measured brain activity with functional magnetic resonance imaging in adults and 13-year-old children. Data were analyzed with an event-related design to isolate activity during cue, delay, distraction, and response selection. Adults were more accurate and less distractible than children. Activity in the middle frontal gyrus and intraparietal cortex was stronger in adults than in children during the delay, when information was maintained in WM. Distraction during the delay evoked activation in parietal and occipital cortices in both adults and children. However, distraction activated frontal cortex only in children. The larger frontal activation in response to distracters presented during the delay may explain why children are more susceptible to interfering stimuli.     

Enhanced temporal non-linearities in human object-related occipito-temporal cortex

To what extent does neural activation in human visual cortex follow the temporal dynamics of the optical retinal stimulus? Specifically, to what extent does stimulus evoked neural activation persist after stimulus termination? In the present study, we used functional magnetic resonance imaging (fMRI) to explore the resulting temporal non-linearities across the entire constellation of human visual areas. Gray-scale images of animals, houses and faces were presented at two different presentation rates - 1 and 4 Hz - and the fMRI signal was analyzed in retinotopic and in high order occipito-temporal visual areas. In early visual areas and the motion sensitive area MT/V5, a fourfold increase in stimulus presentation rate evoked a twofold increase in signal amplitude. However, in high order visual areas, signal amplitude increased only by 25%. A control experiment ruled out the possibility that this difference was due to signal saturation ('ceiling') effects. A likely explanation for the stronger non-linearities in occipito-temporal cortex is a persistent neuronal activation that continues well after stimulus termination in the 1 Hz condition. These persistent activations might serve as a short term (iconic) memory mechanism for preserving a trace of the stimulus even in its absence and for future integration with temporally correlated stimuli. Two alternative models of persistence (inhibitory and excitatory) are proposed to explain the data.     

Rapid processing of emotional expressions without conscious awareness

Rapid accurate categorization of the emotional state of our peers is of critical importance and as such many have proposed that facial expressions of emotion can be processed without conscious awareness. Typically, studies focus selectively on fearful expressions due to their evolutionary significance, leaving the subliminal processing of other facial expressions largely unexplored. Here, I investigated the time course of processing of 3 facial expressions (fearful, disgusted, and happy) plus an emotionally neutral face, during objectively unaware and aware perception. Participants completed the challenging "which expression?" task in response to briefly presented backward-masked expressive faces. Although participant's behavioral responses did not differentiate between the emotional content of the stimuli in the unaware condition, activity over frontal and occipitotemporal (OT) brain regions indicated an emotional modulation of the neuronal response. Over frontal regions this was driven by negative facial expressions and was present on all emotional trials independent of later categorization. Whereas the N170 component, recorded on lateral OT electrodes, was enhanced for all facial expressions but only on trials that would later be categorized as emotional. The results indicate that emotional faces, not only fearful, are processed without conscious awareness at an early stage and highlight the critical importance of considering categorization response when studying subliminal perception.     

Neural correlates of different types of deception: an fMRI investigation

Deception is a complex cognitive activity, and different types of lies could arise from different neural systems. We investigated this possibility by first classifying lies according to two dimensions, whether they fit into a coherent story and whether they were previously memorized. fMRI revealed that well-rehearsed lies that fit into a coherent story elicit more activation in right anterior frontal cortices than spontaneous lies that do not fit into a story, whereas the opposite pattern occurs in the anterior cingulate and in posterior visual cortex. Furthermore, both types of lies elicited more activation than telling the truth in anterior prefrontal cortices (bilaterally), the parahippocampal gyrus (bilaterally), the right precuneus, and the left cerebellum. At least in part, distinct neural networks support different types of deception.     

Priming of motion direction and area V5/MT: a test of perceptual memory

Presentation of supraliminal or subliminal visual stimuli that can (or cannot) be detected or identified can improve the probability of the same stimulus being detected over a subsequent period of seconds, hours or longer. The locus and nature of this perceptual priming effect was examined, using suprathreshold stimuli, in subjects who received repetitive pulse transcranial magnetic stimulation over the posterior occipital cortex, the extrastriate motion area V5/MT or the right posterior parietal cortex during the intertrial interval of a visual motion direction discrimination task. Perceptual priming observed in a control condition was abolished when area V5/MT was stimulated but was not affected by magnetic stimulation over striate or parietal sites. The effect of transcranial magnetic stimulation (TMS) on priming was specific to site (V5/MT) and to task - colour priming was unaffected by TMS over V5/MT. The results parallel, in the motion domain, recent demonstrations of the importance of macaque areas V4 and TEO for priming in the colour and form domains.     

Repetition suppression and reactivation in auditory-verbal short-term recognition memory

The neural response to stimulus repetition is not uniform across brain regions, stimulus modalities, or task contexts. For instance, it has been observed in many functional magnetic resonance imaging (fMRI) studies that sometimes stimulus repetition leads to a relative reduction in neural activity (repetition suppression), whereas in other cases repetition results in a relative increase in activity (repetition enhancement). In the present study, we hypothesized that in the context of a verbal short-term recognition memory task, repetition-related "increases" should be observed in the same posterior temporal regions that have been previously associated with "persistent activity" in working memory rehearsal paradigms. We used fMRI and a continuous recognition memory paradigm with short lags to examine repetition effects in the posterior and anterior regions of the superior temporal cortex. Results showed that, consistent with our hypothesis, the 2 posterior temporal regions consistently associated with working memory maintenance, also show repetition increases during short-term recognition memory. In contrast, a region in the anterior superior temporal lobe showed repetition suppression effects, consistent with previous research work on perceptual adaptation in the auditory-verbal domain. We interpret these results in light of recent theories of the functional specialization along the anterior and posterior axes of the superior temporal lobe.     

Cortical Networks for Visual Reaching: Physiological and Anatomical Organization of Frontal and Parietal Lobe Arm Regions

The functional and structural properties of the dorsolateralfrontal lobe and posterior parietal proximal arm representationswere studied in macaque monkeys. Physiological mapping of primarymotor (MI), dorsal premotor (PMd), and posterior parietal (area5) cortices was performed in behaving monkeys trained in aninstructed-delay reaching task. The parietofrontal corticocorticatconnectivities of these same areas were subsequently examinedanatomically by means of retrograde tracing techniques. Signal-, set-, movement-, and position-related directional neuronalactivities were distributed nonuniformly within the task-relatedareas in both frontal and parietal cortices. Within the frontallobe, moving caudally from PMd to the MI, the activity thatsignals for the visuospatial events leading to target localizationdecreased, while the activity more directly linked to movementgeneration increased. Physiological recordings in the superior parietal lobule revealeda gradient-like distribution of functional properties similarto that observed in the frontal lobe. Signal- and set-relatedactivities were encountered more frequently in the intermediateand ventral part of the medial bank of the intraparietal sulcus(IPS), in area MIP. Movement- and position-related activitieswere distributed more uniformly within the superior parietallobule (SPL), in both dorsal area 5 and in MIP. Frontal and parietal regions sharing similar functional propertieswere preferentially connected through their association pathways.As a result of this study, area MIP, and possibly areas MDPand 7m as well, emerge as the parietal nodes by which visualinformation may be relayed to the frontal lobe arm region. Theseparietal and frontal areas, along with their association connections,represent a potential cortical network for visual reaching.The architecture of this network is ideal for coding reachingas the result of a combination between visual and somatic information.     

Where bottom-up meets top-down: neuronal interactions during perception and imagery

Functional magnetic resonance imaging (fMRI) studies have identified category-selective regions in ventral occipito-temporal cortex that respond preferentially to faces and other objects. The extent to which these patterns of activation are modulated by bottom-up or top-down mechanisms is currently unknown. We combined fMRI and dynamic causal modelling to investigate neuronal interactions between occipito-temporal, parietal and frontal regions, during visual perception and visual imagery of faces, houses and chairs. Our results indicate that, during visual perception, category-selective patterns of activation in extrastriate cortex are mediated by content-sensitive forward connections from early visual areas. In contrast, during visual imagery, category-selective activation is mediated by content-sensitive backward connections from prefrontal cortex. Additionally, we report content-unrelated connectivity between parietal cortex and the category-selective regions, during both perception and imagery. Thus, our investigation revealed that neuronal interactions between occipito-temporal, parietal and frontal regions are task- and stimulus-dependent. Sensory representations of faces and objects are mediated by bottom-up mechanisms arising in early visual areas and top-down mechanisms arising in prefrontal cortex, during perception and imagery respectively. Additionally non-selective, top-down processes, originating in superior parietal areas, contribute to the generation of mental images, regardless of their content, and their maintenance in the 'mind's eye'.     

Frontoparietal network involved in successful retrieval from episodic memory. Spatial and temporal analyses using fMRI and ERP

The neural basis for successful recognition of previously studied items, referred to as "retrieval success," has been investigated using either neuroimaging or brain potentials; however, few studies have used both modalities. Our study combined event-related functional magnetic resonance imaging (fMRI) and event-related potential (ERP) in separate groups of subjects. The neural responses were measured while the subjects performed an old/new recognition task with pictures that had been previously studied in either a deep- or shallow-encoding condition. The fMRI experiment showed that among the frontoparietal regions involved in retrieval success, the inferior frontal gyrus and intraparietal sulcus were crucial to conscious recollection because the activity of these regions was influenced by the depth of memory at encoding. The activity of the right parietal region in response to a repeated item was modulated by the repetition lag, indicating that this area would be critical to familiarity-based judgment. The results of structural equation modeling revealed that the functional connectivity among the regions in the left hemisphere was more significant than that in the right hemisphere. The results of the ERP experiment and independent component analysis paralleled those of the fMRI experiment and demonstrated that the repeated item produced an earlier peak than the hit item by approximately 50 ms.