Retinotopy and attention in human occipital, temporal, parietal, and frontal cortex

Novel mapping stimuli composed of biological motion figures were used to study the extent and layout of multiple retinotopic regions in the entire human brain and to examine the independent manipulation of retinotopic responses by visual stimuli and by attention. A number of areas exhibited retinotopic activations, including full or partial visual field representations in occipital cortex, the precuneus, motion-sensitive temporal cortex (extending into the superior temporal sulcus), the intraparietal sulcus, and the vicinity of the frontal eye fields in frontal cortex. Early visual areas showed mainly stimulus-driven retinotopy; parietal and frontal areas were driven primarily by attention; and lateral temporal regions could be driven by both. We found clear spatial specificity of attentional modulation not just in early visual areas but also in classical attentional control areas in parietal and frontal cortex. Indeed, strong spatiotopic activity in these areas could be evoked by directed attention alone. Conversely, motion-sensitive temporal regions, while exhibiting attentional modulation, also responded significantly when attention was directed away from the retinotopic stimuli.     

Attentional modulation of receptive field structure in area 7a of the behaving monkey

Spatial attention modulates the activity of inferior parietal neurons. A statistically rigorous approach to classical retinotopic mapping was used to quantify the receptive fields of area 7a neurons under 2 attentional conditions. Measurements were made with retinal stimulation held constant and the locus of attention manipulated covertly. Both tasks required central fixation but differed in the locus of covert attention (either on the center fixation point or on a peripheral square target in one of 25 locations). The neuron's identity over the recording session was confirmed using chaos theory to characterize unique temporal patterns. Sixty-six percent of the neurons changed prestimulus activity based on task state. Retinotopic mapping showed no evidence for foveal sparing. Attentional factors influenced visual responses for approximately 30% of the neurons. Two types of modulation were equally observed. One group of cells had a multiplicative scaling of response, with equal instances of enhancement and suppression. A second group of cells had a complex interaction of visual and attentional signals, such that spatial tuning was subject to a nonlinear modulation across the visual field based on attentional constraints. These 2 cell groups may have different roles in the shift of attention preceding motor behaviors and may underlie shifts in parietal retinotopic maps observed with intrinsic optical imaging.     

A frontoparietal network for spatial attention reorienting in the auditory domain: a human fMRI/MEG study of functional and temporal dynamics

Several studies have identified a supramodal network critical to the reorienting of attention toward stimuli at novel locations and which involves the right temporoparietal junction and the inferior frontal areas. The present functional magnetic resonance imaging (fMRI)\magnetoencephalography (MEG) study investigates: 1) the cerebral circuit underlying attentional reorienting to spatially varying sound locations; 2) the circuit related to the regular change of sound location in the same hemifield, the change of sound location across hemifields, or sounds presented randomly at different locations on the azimuth plane; 3) functional temporal dynamics of the observed cortical areas exploiting the complementary characteristics of the fMRI and MEG paradigms. fMRI results suggest 3 distinct roles: the supratemporal plane appears modulated by variations of sound location; the inferior parietal lobule is modulated by the cross-meridian effect; and the inferior frontal cortex is engaged by the inhibition of a motor response. MEG data help to elucidate the temporal dynamics of this network by providing high-resolution time series with which to measure latency of neural activation manipulated by the reorienting of attention.     

Dissociation of stimulus relevance and saliency factors during shifts of visuospatial attention

The control of visuospatial attention entails multiple processes, including both voluntary (endogenous) factors and stimulus-driven (exogenous) factors. Exogenous processes can be triggered by visual targets presented at a previously unattended location, thus capturing attention in a stimulus-driven manner. However, little is known about the relative role of stimulus salience and behavioral relevance for this type of spatial reorienting. Here, we directly assessed how salience and relevance affect activation of the frontoparietal attentional system, using either low-salience but task-relevant target stimuli or salient but task-irrelevant flickering checkerboards. We compared event-related functional magnetic resonance imaging responses for stimuli presented at the unattended versus attended side (invalid minus valid trials), separately for the 2 categories of visual stimuli. We found that task-relevant invalid targets activated the frontoparietal attentional network, demonstrating that this system engages when target stimuli are presented at an unattended location, even when these have a low perceptual salience. Conversely, the presentation of high-salience checkerboards in one hemifield while endogenous attention was engaged elsewhere did not activate the attentional network. These findings indicate that task relevance is critical for stimulus-driven engagement of the attentional network when attentional resources are endogenously allocated somewhere else.     

Distinct causal influences of parietal versus frontal areas on human visual cortex: evidence from concurrent TMS-fMRI

It has often been proposed that regions of the human parietal and/or frontal lobe may modulate activity in visual cortex, for example, during selective attention or saccade preparation. However, direct evidence for such causal claims is largely missing in human studies, and it remains unclear to what degree the putative roles of parietal and frontal regions in modulating visual cortex may differ. Here we used transcranial magnetic stimulation (TMS) and functional magnetic resonance imaging (fMRI) concurrently, to show that stimulating right human intraparietal sulcus (IPS, at a site previously implicated in attention) elicits a pattern of activity changes in visual cortex that strongly depends on current visual context. Increased intensity of IPS TMS affected the blood oxygen level-dependent (BOLD) signal in V5/MT+ only when moving stimuli were present to drive this visual region, whereas TMS-elicited BOLD signal changes were observed in areas V1-V4 only during the absence of visual input. These influences of IPS TMS upon remote visual cortex differed significantly from corresponding effects of frontal (eye field) TMS, in terms of how they related to current visual input and their spatial topography for retinotopic areas V1-V4. Our results show directly that parietal and frontal regions can indeed have distinct patterns of causal influence upon functional activity in human visual cortex.     

Maintaining and shifting attention within left or right hemifield

Positron emission tomography (PET) was used to examine two questions: (i) which structures of the intact human brain change their activity with the direction of attention to left or right visual field; and (ii) how does activity in these structures, and in parietal cortex in particular, depend on the frequency of attentional shifts? Subjects were required to discriminate the orientation of peripheral gratings. The two main experimental variables were the attended hemifield (left or right) and the proportion of trials requiring a shift within that hemifield (20% or 80%). A detection control condition was also included. Behaviourally, subjects were less accurate and significantly slower when a trial required a shift than when it did not. Ventral and lateral occipital areas showed significantly higher blood flow levels contralateral to the direction of attention. Replicating previous work, there was also a significant main effect of the direction of attention in left lateral prefrontal cortex: blood flow levels were higher during leftward attention in comparison both to baseline and to rightward attention. This left frontal effect reached significance in single subjects in whom several activation sites could be distinguished within left middle and inferior frontal gyrus. Right and left parietal cortex were activated during both left- and right-field attention conditions, with a tendency for higher activity levels when attention was directed contralaterally. Contrary to the experimental hypothesis, however, parietal regions were not activated differentially by high versus low numbers of attentional shifts. The current experiment confirms that left frontal convexity is sensitive to manipulations of the direction of visuospatial attention. The results do not indicate a specific role of parietal cortex in attentional shifting.     

Additive effects of emotional content and spatial selective attention on electrocortical facilitation

Affectively arousing visual stimuli have been suggested to automatically attract attentional resources in order to optimize sensory processing. The present study crosses the factors of spatial selective attention and affective content, and examines the relationship between instructed (spatial) and automatic attention to affective stimuli. In addition to response times and error rate, electroencephalographic data from 129 electrodes were recorded during a covert spatial attention task. This task required silent counting of random-dot targets embedded in a 10 Hz flicker of colored pictures presented to both hemifields. Steady-state visual evoked potentials (ssVEPs) were obtained to determine amplitude and phase of electrocortical responses to pictures. An increase of ssVEP amplitude was observed as an additive function of spatial attention and emotional content. Statistical parametric mapping of this effect indicated occipito-temporal and parietal cortex activation contralateral to the attended visual hemifield in ssVEP amplitude modulation. This difference was most pronounced during selection of the left visual hemifield, at right temporal electrodes. In line with this finding, phase information revealed accelerated processing of aversive arousing, compared to affectively neutral pictures. The data suggest that affective stimulus properties modulate the spatiotemporal process along the ventral stream, encompassing amplitude amplification and timing changes of posterior and temporal cortex.     

Perinatal-lesion-induced reorganization of cerebral functions revealed using reversible cooling deactivation and attentional tasks

We tested the concept that lesions of primary visual cortical areas 17 and 18 sustained on the day of birth induce a redistribution of cerebral operations underlying the ability to disengage visual attention and then redirect it to a new location. In cats, these operations are normally highly localizable to posterior middle suprasylvian (pMS) cortex. Three stimulation paradigms were used: (i) movement of a high contrast visual stimulus into the visual field; (ii) illumination of a static light-emitting diode (LED) stimulus; and (iii) a control static auditory stimulus. To test for the redistribution of critical neural operations, cryoloops were implanted bilaterally in the pMS sulcus and in contact with ventral posterior suprasylvian (vPS) cortex. Separate and combined deactivations of pMS and vPS cortices in cats with early lesions of primary visual cortex showed that full, unilateral deactivation of pMS cortex only partially impaired the ability to detect and orient to stimuli moved into the contracooled hemifield. Much more complete impairment required the additional deactivation of ipsilateral vPS cortex. Bilateral pMS deactivation alone, or in combination with bilateral vPS deactivation, largely reversed the unilateral contracooled neglect. For the orienting to static, illuminated LED stimuli, unilateral deactivation of pMS cortex was sufficient to fully impair orienting to stimuli presented in the contracooled hemifield. Bilateral pMS deactivation induced an almost complete visual-field-wide neglect of stimuli. On its own, unilateral deactivation of vPS cortex was without effect on either task, although bilateral vPS deactivations introduced inconsistencies into the performance. Termination of cooling reversed all deficits. Finally, neither the initial lesion of areas 17 and 18 nor cooling of either the MS or vPS cortex alone, or in combination, interfered with orienting to sound stimuli. Overall, our results provide evidence that at least one highly localizable visual function of normal cerebral cortex is remapped across the cortical surface following the early lesion of primary visual cortical areas 17 and 18. Moreover, the redistribution has spread the essential neural operations from the visual parietal cortex to a normally functionally distinct type of cortex in the visual temporal system.     

Attentional functions of parietal and frontal cortex

A model of normal attentional function, based on the concept of competitive parallel processing, is used to compare attentional deficits following parietal and frontal lobe lesions. Measurements are obtained for visual processing speed, capacity of visual short-term memory (VSTM), spatial bias (bias to left or right hemifield) and top-down control (selective attention based on task relevance). The results show important differences, but also surprising similarities, in parietal and frontal lobe patients. For processing speed and VSTM, deficits are selectively associated with parietal lesions, in particular lesions of the temporoparietal junction. We discuss explanations based on either grey matter or white matter lesions. In striking contrast, measures of attentional weighting (spatial bias and top-down control) are predicted by simple lesion volume. We suggest that attentional weights reflect competition between broadly distributed object representations. Parietal and frontal mechanisms work together, both in weighting by location and weighting by task context.     

Retinotopic organization in human visual cortex and the spatial precision of functional MRI

A method of using functional magnetic resonance imaging (fMRI) to measure retinotopic organization within human cortex is described. The method is based on a visual stimulus that creates a traveling wave of neural activity within retinotopically organized visual areas. We measured the fMRI signal caused by this stimulus in visual cortex and represented the results on images of the flattened cortical sheet. We used the method to locate visual areas and to evaluate the spatial precision of fMRI. Specifically, we: (i) identified the borders between several retinotopically organized visual areas in the posterior occipital lobe; (ii) measured the function relating cortical position to visual field eccentricity within area V1; (iii) localized activity to within 1.1 mm of visual cortex; and (iv) estimated the spatial resolution of the fMRI signal and found that signal amplitude falls to 60% at a spatial frequency of 1 cycle per 9 mm of visual cortex. This spatial resolution is consistent with a linespread whose full width at half maximum spreads across 3.5 mm of visual cortex.      

Modulation of connectivity in visual pathways by attention: cortical interactions evaluated with structural equation modelling and fMRI

Electrophysiological and neuroimaging studies have shown that attention to visual motion can increase the responsiveness of the motion- selective cortical area V5 and the posterior parietal cortex (PP). Increased or decreased activation in a cortical area is often attributed to attentional modulation of the cortical projections to that area. This leads to the notion that attention is associated with changes in connectivity. We have addressed attentional modulation of effective connectivity using functional magnetic resonance imaging (fMRI). Three subjects were scanned under identical stimulus conditions (visual motion) while varying only the attentional component of the task. Haemodynamic responses defined an occipito-parieto-frontal network, including the, primary visual cortex (V1), V5 and PR A structural equation model of the interactions among these dorsal visual pathway areas revealed increased connectivity between V5 and PP related to attention. On the basis of our analysis and the neuroanatomical pattern of projections from the prefrontal cortex to PP we attributed the source of modulatory influences, on the posterior visual pathway, to the prefrontal cortex (PFC). To test this hypothesis we included the PFC in our model as a 'modulator' of the pathway between V5 and PP, using interaction terms in the structural equation model. This analysis revealed a significant modulatory effect of prefrontal regions on V5 afferents to posterior parietal cortex.      

Right parietal cortex plays a critical role in change blindness

There is increasing evidence from functional magnetic resonance imaging (fMRI) that visual awareness is not only associated with activity in ventral visual cortex but also with activity in the parietal cortex. However, due to the correlational nature of neuroimaging, it remains unclear whether this parietal activity plays a causal role in awareness. In the experiment presented here we disrupted activity in right or left parietal cortex by applying repetitive transcranial magnetic stimulation (rTMS) over these areas while subjects attempted to detect changes between two images separated by a brief interval (i.e. 1-shot change detection task). We found that rTMS applied over right parietal cortex but not left parietal cortex resulted in longer latencies to detect changes and a greater rate of change blindness compared with no TMS. These results suggest that the right parietal cortex plays a critical role in conscious change detection.     

Cerebral bases of subliminal and supraliminal priming during reading

Several studies have investigated the neural correlates of conscious perception by contrasting functional magnetic resonance imaging (fMRI) activation to conscious and nonconscious visual stimuli. The results often reveal an amplification of posterior occipito-temporal activation and its extension into a parieto-frontal network. However, some of these effects might be due to a greater deployment of attentional or strategical processes in the conscious condition. Here, we examined the brain activity evoked by visible and invisible stimuli, both of which were irrelevant to the task. We collected fMRI data in a masking paradigm in which subliminal versus supraliminal letter strings were presented as primes while subjects focused attention on another subsequent, highly visible target word. Under those conditions, prime visibility was associated with greater activity confined to bilateral posterior occipito-temporal cortices, without extension into frontal and parietal cortices. However, supraliminal primes, compared with subliminal primes, evoked more extensive repetition suppression in a widely distributed set of parieto-frontal areas. Furthermore, only supraliminal primes caused phonological repetition enhancement in left inferior frontal and anterior insular cortex. Those results suggest a 2-stage view of conscious access: Relative to masked stimuli, unmasked stimuli elicit increased occipito-temporal activity, thus allowing them to compete for global conscious access and to induce priming in multiple distant areas. In the absence of attention, however, their access to a second stage of distributed parieto-frontal processing may remain blocked.     

A comparison of visual and auditory motion processing in human cerebral cortex

Visual and auditory motion information can be used together to provide complementary information about the movement of objects. To investigate the neural substrates of such cross-modal integration, functional magnetic resonance imaging was used to assess brain activation while subjects performed separate visual and auditory motion discrimination tasks. Areas of unimodal activation included the primary and/or early sensory cortex for each modality plus additional sites extending toward parietal cortex. Areas conjointly activated by both tasks included lateral parietal cortex, lateral frontal cortex, anterior midline and anterior insular cortex. The parietal site encompassed distinct, but partially overlapping, zones of activation in or near the intraparietal sulcus (IPS). A subsequent task requiring an explicit cross-modal speed comparison revealed several foci of enhanced activity relative to the unimodal tasks. These included the IPS, anterior midline, and anterior insula but not frontal cortex. During the unimodal auditory motion task, portions of the dorsal visual motion system showed signals depressed below resting baseline. Thus, interactions between the two systems involved either enhancement or suppression depending on the stimuli present and the nature of the perceptual task. Together, these results identify human cortical regions involved in polysensory integration and the attentional selection of cross-modal motion information.     

An fMRI version of the Farnsworth-Munsell 100-Hue test reveals multiple color-selective areas in human ventral occipitotemporal cortex.

Studies of patients with cerebral achromatopsia have suggested that ventral occipitotemporal cortex is important for color perception. We created a functional magnetic resonance imaging (fMRI) version of a clinical test commonly used to assess achromatopsia, the Farnsworth-Munsell 100-Hue test. The test required normal subjects to use color information in the visual stimulus to perform a color sequencing task. A modification of the test requiring ordering by luminance was used as a control task. Subjects were also imaged as they passively viewed colored stimuli. A limited number of areas responded more to chromatic than achromatic stimulation, including primary visual cortex. Most color-selective activity was concentrated in ventral occipitotemporal cortex. Several areas in ventral cortex were identified. The most posterior, located in posterior fusiform gyrus, corresponded to the area activated by passive viewing of colored stimuli. More anterior and medial color-selective areas were located in the collateral sulcus and fusiform gyrus. These more anterior areas were not identified in previous imaging studies which used passive viewing of colored stimuli, and were most active in our study when visual color information was behaviorally relevant, suggesting that attention influences activity in color-selective areas. The fMRI version of the Farnsworth-Munsell test may be useful in the study of achromatopsia.     

Electrophysiological evidence for temporal dissociation between spatial attention and sensory competition during human face processing

Scalp event-related potential (ERP) studies in humans indicate that face processes taking place between 130 and 170 ms after stimulus onset at posterior sites (N170) are strongly reduced when another face stimulus is processed concurrently or has been presented shortly before for a prolonged period. These observations suggest that neural representations of individual faces compete in the occipitotemporal cortex as early as 130 ms. Here, we tested the respective role of spatial attention and sensory competition in accounting for the amplitude reduction of the N170 during concurrent face stimulation. ERPs time locked to a lateralized face stimulus were recorded while subjects were fixating either a face or a controlled scrambled-face stimulus (context factor) and were engaged in either a high- or a low-attentional load task at fixation (task factor). The N170 amplitude to the lateralized face stimulus was reduced both when the central stimulus was a face compared with a scrambled face and when the attentional load at fixation was high. However, these effects of context and task factors were largely additive. Most importantly, spatial attention modulated visual processes as early as 80 ms after stimulus onset, whereas sensory competition effects started at about 130 ms. These results provide strong evidence that the N170 in response to faces is modulated by spatial attention, and also that spatial attention and sensory competition do not reflect the same mechanisms of early selection of visual information in the extrastriate cortex.     

Two attentional processes in the parietal lobe

We report fMRI evidence for two attentional processes in parietal cortex. Subjects matched a feature, cued by a word, to a test display of moving colored dots. Either color (red, green) or motion direction (left, right) was cued on mixed scans while only one dimension was cued on blocked scans. An event-related paradigm separated the preparatory activity generated by the cue from the subsequent activity related to the test display. One attentional process specified task information while a second process was motion selective. During the cue period, a pure effect of task specification was observed in left frontal cortex while combined effects of task specification and motion selectivity were observed in left posterior parietal cortex. The frontal task-specification signal may have been the source of the corresponding signal in parietal cortex. Effects of task specification generalized over cue dimension, indicating that the information was coded in a sufficiently abstract form to affect color and motion processing. During the subsequent test period, task-specification and motion-selective signals were again observed in left parietal cortex. Task specification did not significantly affect occipital motion-selective regions, such as MT+, however, indicating that this process did not influence the lower cortical tier of the motion processing stream. These results provide evidence for general and specialized task representations within left parietal cortex during task preparation and execution.     

Directing attention to locations and to sensory modalities: multiple levels of selective processing revealed with PET

We used positron emission tomography (PET) to investigate the neural correlates of selective attention in humans. We examined the effects of attending to one side of space versus another (spatial selection) and to one sensory modality versus another (intermodal selection) during bilateral, bimodal stimulation of vision and touch. Attention toward one side resulted in greater activity in several contralateral areas. In somatosensory cortex, these spatial attentional modulations were found only when touch was relevant. In the intraparietal sulcus, spatial attentional effects were multimodal, independent of the modality attended. In occipital areas, spatial modulations were also found during both visual and tactile attention, indicating that tactile attention can affect activity in visual cortex; but occipital areas also showed more activity overall during visual attention. This suggests that while spatial attention can exert multimodal influences on visual areas, these still maintain their specificity for the visual modality. Additionally, irrespective of the attended side, attending to vision activated posterior parietal and superior premotor cortices, while attending to touch activated the parietal operculi. We conclude that attentional selection operates at multiple levels, with attention to locations and attention to modalities showing distinct effects. These jointly contribute to boost processing of stimuli at the attended location in the relevant modality.     

Color discrimination involves ventral and dorsal stream visual areas

We used positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) in human subjects to investigate whether the ventral and dorsal visual stream cooperate when active judgements about color have to be made. Color was used as the attribute, because it is processed primarily in the ventral stream. The centrally positioned stimuli were equiluminant shades of brown. The successive color discrimination task was contrasted to a dimming detection task, in which retinal input was identical but with double the number of motor responses. The stimulus presentation rate was parametrically varied and a constant performance level was obtained for all conditions. The visual activation sites were identified by retinotopic mapping and cortical flattening. In addition, one psychophysical and two fMRI experiments were performed to control for differences in visuospatial attention and motor output. Successive color discrimination involved early visual areas, including V1 and VP and the ventral color-responsive region, as well as anterior and middle dorsal intraparietal sulcus, dorsal premotor cortex and pre-SMA. Cortical regions involved in dimming detection and motor output included area V3A, hMT/V5+, lateral occipital sulcus, posterior dorsal intraparietal sulcus, primary motor cortex and SMA. These experiments demonstrated that even with color as the attribute, successive discrimination, in which a decision process has to link visual signals to motor responses, involves both ventral and dorsal visual stream areas.     

Retinotopic organization of the visual cortex before and after decompression of the optic chiasm in a patient with pituitary macroadenoma

Compression induced by a pituitary tumor on the optic chiasm can generate visual field deficits, yet it is unknown how this compression affects the retinotopic organization of the visual cortex. It is also not known how the effect of the tumor on the retinotopic organization of the visual cortex changes after decompression. The authors used functional MRI (fMRI) to map the retinotopic organization of the visual cortex in a 68-year-old right-handed woman before and 3 months after surgery for a recurrent pituitary macroadenoma. The authors demonstrated that longitudinal changes in visual field perimetry, as assessed by the automated Humphrey visual field test, correlated with longitudinal changes in fMRI activation in a retinotopic manner. In other words, after decompression of the optic chiasm, fMRI charted the recruitment of the visual cortex in a way that matched gains in visual field perimetry. On the basis of this case, the authors propose that fMRI can chart neural plasticity of the visual cortex on an individual basis and that it can also serve as a complementary tool in decision making with respect to management of patients with chiasmal compression.