Topographic maps of visual spatial attention in human parietal cortex

Functional magnetic resonance imaging (fMRI) was used to measure activity in human parietal cortex during performance of a visual detection task in which the focus of attention systematically traversed the visual field. Critically, the stimuli were identical on all trials (except for slight contrast changes in a fully randomized selection of the target locations) whereas only the cued location varied. Traveling waves of activity were observed in posterior parietal cortex consistent with shifts in covert attention in the absence of eye movements. The temporal phase of the fMRI signal in each voxel indicated the corresponding visual field location. Visualization of the distribution of temporal phases on a flattened representation of parietal cortex revealed at least two distinct topographically organized cortical areas within the intraparietal sulcus (IPS), each representing the contralateral visual field. Two cortical areas were proposed based on this topographic organization, which we refer to as IPS1 and IPS2 to indicate their locations within the IPS. This nomenclature is neutral with respect to possible homologies with well-established cortical areas in the monkey brain. The two proposed cortical areas exhibited relatively little response to passive visual stimulation in comparison with early visual areas. These results provide evidence for multiple topographic maps in human parietal cortex.     

Orientation-tuned FMRI adaptation in human visual cortex

Adaptation is a general property of almost all neural systems and has been a longstanding tool of psychophysics because of its power to isolate and temporarily reduce the contribution of specific neural populations. Recently, adaptation designs have been extensively applied in functional MRI (fMRI) studies to infer neural selectivity in specific cortical areas. However, there has been considerable variability in the duration of adaptation used in these experiments. In particular, although long-term adaptation has been solidly established in psychophysical and neurophysiological studies, it has been incorporated into few fMRI studies. Furthermore, there has been little validation of fMRI adaptation using stimulus dimensions with well-known adaptive properties (e.g., orientation) and in better understood regions of cortex (e.g., primary visual cortex, V1). We used an event-related fMRI experiment to study long-term orientation adaptation in the human visual cortex. After long-term adaptation to an oriented pattern, the fMRI response in V1, V2, V3/VP, V3A, and V4 to a test stimulus was proportional to the angular difference between the adapting and test stimuli. However, only V3A and V4 showed this response pattern with short-term adaptation. In a separate experiment, we measured behavioral contrast detection thresholds after adaptation and found that the fMRI signal in V1 closely matched the psychophysically derived contrast detection thresholds. Similar to the fMRI results, adaptation induced threshold changes strongly depended on the duration of adaptation. In addition to supporting the existence of adaptable orientation-tuned neurons in human visual cortex, our results show the importance of considering timing parameters in fMRI adaptation experiments.     

Uncertainty and invariance in the human visual cortex

The way in which input noise perturbs the behavior of a system depends on the internal processing structure of the system. In visual psychophysics, there is a long tradition of using external noise methods (i.e., adding noise to visual stimuli) as tools for system identification. Here, we demonstrate that external noise affects processing of visual scenes at different cortical areas along the human ventral visual pathway, from retinotopic regions to higher occipitotemporal areas implicated in visual shape processing. We found that when the contrast of the stimulus was held constant, the further away from the retinal input a cortical area was the more its activity, as measured with functional magnetic resonance imaging (fMRI), depended on the signal-to-noise ratio (SNR) of the visual stimulus. A similar pattern of results was observed when trials with correct and incorrect responses were analyzed separately. We interpret these findings by extending signal detection theory to fMRI data analysis. This approach reveals the sequential ordering of decision stages in the cortex by exploiting the relation between fMRI response and stimulus SNR. In particular, our findings provide novel evidence that occipitotemporal areas in the ventral visual pathway form a cascade of decision stages with increasing degree of signal uncertainty and feature invariance.     

Rapid and precise retinotopic mapping of the visual cortex obtained by voltage-sensitive dye imaging in the behaving monkey

Retinotopy is a fundamental organizing principle of the visual cortex. Over the years, a variety of techniques have been used to examine it. None of these techniques, however, provides a way to rapidly characterize retinotopy, at the submillimeter range, in alert, behaving subjects. Voltage-sensitive dye imaging (VSDI) can be used to monitor neuronal population activity at high spatial and temporal resolutions. Here we present a VSDI protocol for rapid and precise retinotopic mapping in the behaving monkey. Two monkeys performed a fixation task while thin visual stimuli swept periodically at a high speed in one of two possible directions through a small region of visual space. Because visual space is represented systematically across the cortical surface, each moving stimulus produced a traveling wave of activity in the cortex that could be precisely measured with VSDI. The time at which the peak of the traveling wave reached each location in the cortex linked this location with its retinotopic representation. We obtained detailed retinotopic maps from a region of about 1 cm(2) over the dorsal portion of areas V1 and V2. Retinotopy obtained during <4 min of imaging had a spatial precision of 0.11-0.19 mm, was consistent across experiments, and reliably predicted the locations of the response to small localized stimuli. The ability to rapidly obtain precise retinotopic maps in behaving monkeys opens the door for detailed analysis of the relationship between spatiotemporal dynamics of population responses in the visual cortex and perceptually guided behavior.     

A dynamic fMRI study of illusory double-flash effect on human visual cortex

Functional MRI (fMRI) combined with the paired-stimuli paradigms (referred as dynamic fMRI) was used to study the “illusory double-flash” effect on brain activity in the human visual cortex. Three experiments were designed. The first two experiments aimed to examine the cross-modal neural interaction between the visual and auditory sensory systems caused by the illusory double-flash effect using combined auditory (beep sound) and visual (light flash) stimuli. The fMRI signal in the visual cortex was significantly increased in response to the illusory double flashes compared to the physical single flash when the inter-stimuli delay between the auditory and visual stimuli was 25 ms. This increase disappeared when the delay was prolonged to ~300 ms. These results reveal that the illusory double-flash effect can significantly affect the brain activity in the visual cortex, and the degree of this effect is dynamically sensitive to the inter-stimuli delay. The third experiment was to address the spatial differentiation of brain activation in the visual cortex in response to the illusory double-flash stimulation. It was found that the illusory double-flash effect in the human visual cortex is much stronger in the periphery than the fovea. This finding suggests that the periphery may be involved in high-level brain processing beyond the retinotopic visual perception. The behavioral measures conducted in this study indicate an excellent correlation between the fMRI results and behavioral performance. Finally, this work demonstrates a unique merit of fMRI for providing both temporal and spatial information regarding cross-modal neural interaction between different sensory systems.     

Retinotopy and color sensitivity in human visual cortical area V8

Prior studies suggest the presence of a color-selective area in the inferior occipital-temporal region of human visual cortex. It has been proposed that this human area is homologous to macaque area V4, which is arguably color selective, but this has never been tested directly. To test this model, we compared the location of the human color-selective region to the retinotopic area boundaries in the same subjects, using functional magnetic resonance imaging (fMRI), cortical flattening and retinotopic mapping techniques. The human color-selective region did not match the location of area V4 (neither its dorsal nor ventral subdivisions), as extrapolated from macaque maps. Instead this region coincides with a new retinotopic area that we call 'V8', which includes a distinct representation of the fovea and both upper and lower visual fields. We also tested the response to stimuli that produce color afterimages and found that these stimuli, like real colors, caused preferential activation of V8 but not V4.     

State dependent activity in monkey visual cortex

Summary This study examined the extent to which the responses of single cells in the striate cortex (V1) and the extrastriate cortex (V4) of the alert rhesus monkey are modulated by visual stimuli whose relevance in a behavioral task is varied. The animal had to detect the repetition of a visual pattern (i.e. detect similarity), preceded by a randomized number of alternations between two different patterns. The responses produced by the last, reward contingent stimulus were compared with responses obtained to that same stimulus earlier in the sequence. Modulatory effects in V1 were moderate: 31% of the cells (63 of 200) showed response increments of 20% or more to the last, reward contingent stimulus. In V4 the effects were much more pronounced: 72% of the cells (110 of 154) showed modulatory effects of more than 20%. In V4 but not in V1 orientation tuning curves showed a significant narrowing as well as a peak response increment to the behaviorally salient stimulus, suggesting a feature specific mechanism associated with the detection of similarity. Although a response decrement was observed in many cells during the repeated alternations, this effect was significantly smaller than the modulation produced by the detection of similarity. Controls included the presentation of novel stimuli during the presentation sequence which did not produce an enhanced response. It is hypothesized that the feature specific effects reported here are produced by higher order feedback systems.     

Physiological correlates of perceptual learning in monkey V1 and V2

Performance in visual discrimination tasks improves with practice. Although the psychophysical parameters of these improvements have suggested the involvement of early areas in visual cortex, there has been little direct study of the physiological correlates of such perceptual learning at the level of individual neurons. To examine how neuronal response properties in the early visual system may change with practice, we trained monkeys for more than 6 mo in an orientation discrimination task in which behaviorally relevant stimuli were restricted to a particular retinal location and oriented around a specific orientation. During training the monkeys' discrimination thresholds gradually improved to much better than those of naive monkeys or humans. Although this improvement was specific to the trained orientation, it showed little retinotopic specificity. The receptive field properties of single neurons from regions representing the trained location and a location in the opposite visual hemifield were measured in V1 and V2. In most respects the receptive field properties in the representations of the trained and untrained regions were indistinguishable. However, in the regions of V1 and V2 representing the trained location, there were slightly fewer neurons whose optimal orientation was near the trained orientation. This resulted in a small but significant decrease in the V1 population response to the trained orientation at the trained location. Consequently, the observed neuronal populations did not exhibit any orientation-specific biases sufficient to explain the orientation specificity of the behavioral improvement. Pooling models suggest that the behavioral improvement was accomplished with a task-dependent and orientation-selective pooling of unaltered signals from early visual neurons. These data suggest that, even for training with stimuli suited to the selectivities found in early areas of visual cortex, behavioral improvements can occur in the absence of pronounced changes in the physiology of those areas.     

Relating retinotopic and object-selective responses in human lateral occipital cortex

What is the relationship between retinotopy and object selectivity in human lateral occipital (LO) cortex? We used functional magnetic resonance imaging (fMRI) to examine sensitivity to retinal position and category in LO, an object-selective region positioned posterior to MT along the lateral cortical surface. Six subjects participated in phase-encoded retinotopic mapping experiments as well as block-design experiments in which objects from six different categories were presented at six distinct positions in the visual field. We found substantial position modulation in LO using standard nonobject retinotopic mapping stimuli; this modulation extended beyond the boundaries of visual field maps LO-1 and LO-2. Further, LO showed a pronounced lower visual field bias: more LO voxels represented the lower contralateral visual field, and the mean LO response was higher to objects presented below fixation than above fixation. However, eccentricity effects produced by retinotopic mapping stimuli and objects differed. Whereas LO voxels preferred a range of eccentricities lying mostly outside the fovea in the retinotopic mapping experiment, LO responses were strongest to foveally presented objects. Finally, we found a stronger effect of position than category on both the mean LO response, as well as the distributed response across voxels. Overall these results demonstrate that retinal position exhibits strong effects on neural response in LO and indicates that these position effects may be explained by retinotopic organization.     

BOLD repetition decreases in object-responsive ventral visual areas depend on spatial attention

Functional imaging studies of priming-related repetition phenomena have become widely used to study neural object representation. Although blood oxygenation level-dependent (BOLD) repetition decreases can sometimes be observed without awareness of repetition, any role for spatial attention in BOLD repetition effects remains largely unknown. We used fMRI in 13 healthy subjects to test whether BOLD repetition decreases for repeated objects in ventral visual cortices depend on allocation of spatial attention to the prime. Subjects performed a size-judgment task on a probe object that had been attended or ignored in a preceding prime display of 2 lateralized objects. Reaction times showed faster responses when the probe was the same object as the attended prime, independent of the view tested (identical vs. mirror image). No behavioral effect was evident from unattended primes. BOLD repetition decreases for attended primes were found in lateral occipital and fusiform regions bilaterally, which generalized across identical and mirror-image repeats. No repetition decreases were observed for ignored primes. Our results suggest a critical role for attention in achieving visual representations of objects that lead to both BOLD signal decreases and behavioral priming on repeated presentation.     

Visual scene processing in familiar and unfamiliar environments

Humans and animals use information obtained from the local visual scene to orient themselves in the wider world. Although neural systems involved in scene perception have been identified, the extent to which processing in these systems is affected by previous experience is unclear. We addressed this issue by scanning subjects with functional magnetic resonance imaging (fMRI) while they viewed photographs of familiar and unfamiliar locations. Scene-selective regions in parahippocampal cortex (the parahippocampal place area, or PPA), retrosplenial cortex (RSC), and the transverse occipital sulcus (TOS) responded more strongly to images of familiar locations than to images of unfamiliar locations with the strongest effects (>50% increase) in RSC. Examination of fMRI repetition suppression (RS) effects indicated that images of familiar and unfamiliar locations were processed with the same degree of viewpoint specificity; however, increased viewpoint invariance was observed as individual scenes became more familiar over the course of a scan session. Surprisingly, these within-scan-session viewpoint-invariant RS effects were only observed when scenes were repeated across different trials but not when scenes were repeated within a trial, suggesting that within- and between-trial RS effects may index different aspects of visual scene processing. The sensitivity to environmental familiarity observed in the PPA, RSC, and TOS supports earlier claims that these regions mediate the extraction of navigationally relevant spatial information from visual scenes. As locations become familiar, the neural representations of these locations become enriched, but the viewpoint invariance of these representations does not change.     

Differential contribution of early visual areas to the perceptual process of contour processing

We investigated contour processing and figure-ground detection within human retinotopic areas using event-related functional magnetic resonance imaging (fMRI) in 6 healthy and na?ve subjects. A figure (6 degrees side length) was created by a 2nd-order texture contour. An independent and demanding foveal letter-discrimination task prevented subjects from noticing this more peripheral contour stimulus. The contour subdivided our stimulus into a figure and a ground. Using localizers and retinotopic mapping stimuli we were able to subdivide each early visual area into 3 eccentricity regions corresponding to 1) the central figure, 2) the area along the contour, and 3) the background. In these subregions we investigated the hemodynamic responses to our stimuli and compared responses with or without the contour defining the figure. No contour-related blood oxygenation level-dependent modulation in early visual areas V1, V3, VP, and MT+ was found. Significant signal modulation in the contour subregions of V2v, V2d, V3a, and LO occurred. This activation pattern was different from comparable studies, which might be attributable to the letter-discrimination task reducing confounding attentional modulation. In V3a, but not in any other retinotopic area, signal modulation corresponding to the central figure could be detected. Such contextual modulation will be discussed in light of the recurrent processing hypothesis and the role of visual awareness.     

Gain control in the response of human visual cortex to plaids

A recent intrinsic signal optical imaging study in tree shrew showed, surprisingly, that the population response of V1 to plaid patterns comprising grating components of equal contrast is predicted by the average of the responses to the individual components (MacEvoy SP, Tucker TR, Fitzpatrick D. Nat Neurosci 12: 637-645, 2009). This prompted us to compare responses to plaids and gratings in human visual cortex as a function of contrast and orientation. We found that the functional MRI (fMRI) blood oxygenation level-dependent (BOLD) responses of areas V1-V3 to a plaid comprising superposed grating components of equal contrast are significantly higher than the responses to a single component. Furthermore, the orientation response profile of a plaid is poorly predicted from a linear combination of the responses to its components. Together, these results indicate that the model of MacEvoy et al. (2009) cannot, without modification, account for the fMRI BOLD response to plaids in human visual cortex.     

Remapping in human visual cortex

With each eye movement, stationary objects in the world change position on the retina, yet we perceive the world as stable. Spatial updating, or remapping, is one neural mechanism by which the brain compensates for shifts in the retinal image caused by voluntary eye movements. Remapping of a visual representation is believed to arise from a widespread neural circuit including parietal and frontal cortex. The current experiment tests the hypothesis that extrastriate visual areas in human cortex have access to remapped spatial information. We tested this hypothesis using functional magnetic resonance imaging (fMRI). We first identified the borders of several occipital lobe visual areas using standard retinotopic techniques. We then tested subjects while they performed a single-step saccade task analogous to the task used in neurophysiological studies in monkeys, and two conditions that control for visual and motor effects. We analyzed the fMRI time series data with a nonlinear, fully Bayesian hierarchical statistical model. We identified remapping as activity in the single-step task that could not be attributed to purely visual or oculomotor effects. The strength of remapping was roughly monotonic with position in the visual hierarchy: remapped responses were largest in areas V3A and hV4 and smallest in V1 and V2. These results demonstrate that updated visual representations are present in cortical areas that are directly linked to visual perception.     

Localization of human cortical areas activated on perception of ordered and chaotic images

The aims of this study were to identify the locations of areas in the human cortex responsible for describing fragmented test images of different degrees of ordering and to identify the areas taking decisions regarding stimuli of this type. The locations of higher visual functions were determined by functional magnetic resonance imaging (fMRI) using a scanner fitted with a superconducting magnet and a field strength of 1.5 T. The blood oxygen level-dependent (BOLD) method was based on measurements of the level of hemoglobin oxygenation in the blood supplied to the brain. This level was taken to be proportional to the extent of neuron activation in the corresponding part of the gray matter. Stimuli were matrixes consisting of Gabor elements of different orientations. The measure of matrix ordering was the ratio of the number of Gabor elements with identical orientations to the total number of elements in the image. Brain neurons were activated by simultaneous changes in the orientations of all the elements, leading to substitution of one matrix by another. Substitution of the orientation was perceived by observers as rotation of the elements in the matrix. Stimulation by matrixes with a high level of ordering was found to activate the occipital areas of the cortex, V1 and V2 (BA17-BA18), while presentation of matrixes with random element orientations also activated the parietal-temporal cortex, V3, V4, V5 (BA19), and the parietal area (BA7). Brain zones responsible for taking decisions regarding the level of order or chaos in the organization of the stimuli are located in different but close areas of the prefrontal and frontal cortex of the brain, including BA6, BA9, and BA10. The results are assessed in terms of concepts of the roles and interactions of different areas of the human brain during recognition of fragmented images of different degrees of complexity.     

Effects of vision restoration training on early visual cortex in patients with cerebral blindness investigated with functional magnetic resonance imaging

Cerebral blindness is a loss of vision as a result of postchiasmatic damage to the visual pathways. Parts of the lost visual field can be restored through training. However, the neuronal mechanisms through which training effects occur are still unclear. We therefore assessed training-induced changes in brain function in eight patients with cerebral blindness. Visual fields were measured with perimetry and retinotopic maps were acquired with functional magnetic resonance imaging (fMRI) before and after vision restoration training. We assessed differences in hemodynamic responses between sessions that represented changes in amplitudes of neural responses and changes in receptive field locations and sizes. Perimetry results showed highly varied visual field recovery with shifts of the central visual field border ranging between 1 and 7°. fMRI results showed that, although retinotopic maps were mostly stable over sessions, there was a small shift of receptive field locations toward a higher eccentricity after training in addition to increases in receptive field sizes. In patients with bilateral brain activation, these effects were stronger in the affected than in the intact hemisphere. Changes in receptive field size and location could account for limited visual field recovery (± 1°), although it could not account for the large increases in visual field size that were observed in some patients. Furthermore, the retinotopic maps strongly matched perimetry measurements before training. These results are taken to indicate that local visual field enlargements are caused by receptive field changes in early visual cortex, whereas large-scale improvement cannot be explained by this mechanism.     

Visual responses of the human superior colliculus: a high-resolution functional magnetic resonance imaging study

The superior colliculus (SC) is a multimodal laminar structure located on the roof of the brain stem. The SC is a key structure in a distributed network of areas that mediate saccadic eye movements and shifts of attention across the visual field and has been extensively studied in nonhuman primates. In humans, it has proven difficult to study the SC with functional MRI (fMRI) because of its small size, deep location, and proximity to pulsating vascular structures. Here, we performed a series of high-resolution fMRI studies at 3 T to investigate basic visual response properties of the SC. The retinotopic organization of the SC was determined using the traveling wave method with flickering checkerboard stimuli presented at different polar angles and eccentricities. SC activations were confined to stimulation of the contralateral hemifield. Although a detailed retinotopic map was not observed, across subjects, the upper and lower visual fields were represented medially and laterally, respectively. Responses were dominantly evoked by stimuli presented along the horizontal meridian of the visual field. We also measured the sensitivity of the SC to luminance contrast, which has not been previously reported in primates. SC responses were nearly saturated by low contrast stimuli and showed only small response modulation with higher contrast stimuli, indicating high sensitivity to stimulus contrast. Responsiveness to stimulus motion in the SC was shown by robust activations evoked by moving versus static dot stimuli that could not be attributed to eye movements. The responses to contrast and motion stimuli were compared with those in the human lateral geniculate nucleus. Our results provide first insights into basic visual responses of the human SC and show the feasibility of studying subcortical structures using high-resolution fMRI.     

Visual FMRI responses in human superior colliculus show a temporal-nasal asymmetry that is absent in lateral geniculate and visual cortex

Eye patching has revealed enhanced saccadic latencies or attention effects when orienting toward visual stimuli presented in the temporal versus nasal hemifields of humans. Such behavioral advantages have been tentatively proposed to reflect possible temporal-nasal differences in the retinotectal pathway to the superior colliculus, rather than in the retinogeniculate pathway or visual cortex. However, this has not been directly tested with physiological measures in humans. Here, we examined responses of the human superior colliculus (SC) to contralateral visual field stimulation, using high spatial resolution fMRI, while manipulating which hemifield was stimulated and orthogonally which eye was patched. The SC responded more strongly to visual stimulation when eye-patching made this stimulation temporal rather than nasal. In contrast, the lateral geniculate nucleus (LGN) plus retinotopic cortical areas V1-V3 did not show any temporal-nasal differences and differed from the SC in this respect. These results provide the first direct physiological demonstration in humans that SC shows temporal-nasal differences that LGN and early visual cortex apparently do not. This may represent a temporal hemifield bias in the strength of the retinotectal pathway, leading to a preference for the contralateral hemifield in the contralateral eye.     

Independence of anticipatory signals for spatial attention from number of nontarget stimuli in the visual field

Covertly attending to a location modulates the activity of visual areas even in the absence of visual stimulation. These effects are widespread, being found in the cortical representations of both attended and unattended portions of the visual field. It is not clear, however, whether preparatory modulations depend on subjects' expectation regarding the presence of additional nontarget stimuli in the visual field. Here, we asked subjects to endogenously direct attention to a peripheral location in the upper visual field, to identify the orientation of a low-contrast target stimulus, and we manipulated the number and behavioral relevance of other low-contrast nontarget stimuli in the visual field. Anticipatory (i.e., prestimulus) blood oxygenation level-dependent (BOLD) signal increments in visual cortex were strongest at the contralateral attended location, whereas signal decrements were strongest at the unattended mirror-opposite ipsilateral location/region of visual cortex. Importantly, these strong anticipatory decrements were not related to the presence/absence of nontarget low-contrast stimuli and did not correlate with either weaker target-evoked responses or worse performance. Second, the presence of other low-contrast stimuli in the visual field, even when potential targets, did not modify the anticipatory signal modulation either at target or nontarget locations. We conclude that the topography of spatial attention-related anticipatory BOLD signal modulation across visual cortex, specifically decrements at unattended locations, is mainly determined by processes at the cued location and not by the number or behavioral relevance of distant low-contrast nontarget stimuli elsewhere in the visual field.     

Differential human brain activation by vertical and horizontal global visual textures

Mid-level visual processes which integrate local orientation information for the detection of global structure can be investigated using global form stimuli of varying complexity. Several lines of evidence suggest that the identification of concentric and parallel organisations relies on different underlying neural substrates. The current study measured brain activation by concentric, horizontal parallel, and vertical parallel arrays of short line segments, compared to arrays of randomly oriented segments. Six subjects were scanned in a blocked design functional magnetic resonance imaging experiment. We compared percentage BOLD signal change during the concentric, horizontal and vertical blocks within early retinotopic areas, the fusiform face area and the lateral occipital complex. Unexpectedly, we found that vertical and horizontal parallel forms differentially activated visual cortical areas beyond V1, but in general, activations to concentric and parallel forms did not differ. Vertical patterns produced the highest percentage signal change overall and only area V3A showed a significant difference between concentric and parallel (horizontal) stimuli, with the former better activating this area. These data suggest that the difference in brain activation to vertical and horizontal forms arises at intermediate or global levels of visual representation since the differential activity was found in mid-level retinotopic areas V2 and V3 but not in V1. This may explain why earlier studies—using methods that emphasised responses to local orientation—did not discover this vertical–horizontal anisotropy.