Differential contribution of early visual areas to the perceptual process of contour processing

We investigated contour processing and figure-ground detection within human retinotopic areas using event-related functional magnetic resonance imaging (fMRI) in 6 healthy and na?ve subjects. A figure (6 degrees side length) was created by a 2nd-order texture contour. An independent and demanding foveal letter-discrimination task prevented subjects from noticing this more peripheral contour stimulus. The contour subdivided our stimulus into a figure and a ground. Using localizers and retinotopic mapping stimuli we were able to subdivide each early visual area into 3 eccentricity regions corresponding to 1) the central figure, 2) the area along the contour, and 3) the background. In these subregions we investigated the hemodynamic responses to our stimuli and compared responses with or without the contour defining the figure. No contour-related blood oxygenation level-dependent modulation in early visual areas V1, V3, VP, and MT+ was found. Significant signal modulation in the contour subregions of V2v, V2d, V3a, and LO occurred. This activation pattern was different from comparable studies, which might be attributable to the letter-discrimination task reducing confounding attentional modulation. In V3a, but not in any other retinotopic area, signal modulation corresponding to the central figure could be detected. Such contextual modulation will be discussed in light of the recurrent processing hypothesis and the role of visual awareness.     

Spatially specific FMRI repetition effects in human visual cortex

The functional MRI (fMRI) response to a pair of identical, successively presented stimuli can result in a smaller signal than the presentation of two nonidentical stimuli. This "repetition effect" has become a frequently used tool to make inferences about neural selectivity in specific cortical areas. However, little is known about the mechanism(s) underlying the effect. In particular, despite many successful applications of the technique in higher visual areas, repetition effects in lower visual areas [e.g., primary visual cortex (V1)] have been more difficult to characterize. One property that is well understood in early visual areas is the mapping of visual field locations to specific areas of the cortex (i.e., retinotopy). We used the retinotopic organization of V1 to activate progressively different populations of neurons in a rapid fMRI experimental design. We observed a repetition effect (reduced signal) when localized stimulus elements were repeated in identical locations. We show that this effect is spatially tuned and largely independent of both interstimulus interval (100-800 ms) and the focus of attention. Using the same timing parameters for which we observed a large effect of spatial position, we also examined the response to orientation changes and observed no effect of an orientation change on the response to repeated stimuli in V1 but significant effects in other retinotopic areas. Given these results, we discuss the possible causes of these repetition effects as well as the implications for interpreting other experiments that use this potentially powerful imaging technique.     

A comparison of magnification functions in area 19 and the lateral suprasylvian visual area in the cat

A retinotopic map can be described by a magnification function that relates magnification factor to visual field eccentricity. Magnification factor for primary visual cortex (VI) in both the cat and the macaque monkey is directly proportional to retinal ganglion cell density. However, among those extrastriate areas for which a magnification function has been described, this is often not the case. Deviations from the pattern established in V1 are of considerable interest because they may provide insight into an extrastriate area's role in visual processing. The present study explored the magnification function for the lateral suprasylvian area (LS) in the cat. Because of its complex retinotopic organization, magnification was calculated indirectly using the known magnification function for area 19. Small tracer injections were made in area 17, and the extent of anterograde label in LS and in area 19 was measured. Using the ratio of cortical area labeled in LS to that in area 19, and the known magnification factor for area 19 at the corresponding retinotopic location, we were able to calculate magnification factor for LS. We found that the magnification function for LS differed substantially from that for area 19: central visual field was expanded, and peripheral field compressed in LS compared with area 19. Additionally, we found that the lower vertical meridian's representation was compressed relative to that of the horizontal meridian. We also examined receptive field size in areas 17, 19, and LS and found that, for all three areas, receptive field size was inversely proportional to magnification factor.     

Neurons with radial receptive fields in monkey area V4A: evidence of a subdivision of prelunate gyrus based on neuronal response properties

In recordings from two awake, behaving macaque monkeys we found that neurons in the crown of the prelunate gyrus differed in their responsiveness to simple visual stimuli. Neurons in the posterior part of the gyrus (area V4) responded strongly to stationary or moving bars, while neurons in the anterior part (area V4A) responded only weakly to such stimuli. Most receptive fields in area V4A were elongated with long axes oriented radially towards the fovea. These neurons were sensitive to radial movements, especially to sudden shifts of real 3D objects. The border between areas V4 and V4A coincided with the representation of the horizontal meridian. Area V4A extended into the posterior bank of the superior temporal sulcus, where its border corresponded to the representation of the vertical meridian. The sequence of the representations of the horizontal and vertical meridians over the prelunate gyrus suggests the existence of another area between V4A and V4t.     

Retinotopy and color sensitivity in human visual cortical area V8

Prior studies suggest the presence of a color-selective area in the inferior occipital-temporal region of human visual cortex. It has been proposed that this human area is homologous to macaque area V4, which is arguably color selective, but this has never been tested directly. To test this model, we compared the location of the human color-selective region to the retinotopic area boundaries in the same subjects, using functional magnetic resonance imaging (fMRI), cortical flattening and retinotopic mapping techniques. The human color-selective region did not match the location of area V4 (neither its dorsal nor ventral subdivisions), as extrapolated from macaque maps. Instead this region coincides with a new retinotopic area that we call 'V8', which includes a distinct representation of the fovea and both upper and lower visual fields. We also tested the response to stimuli that produce color afterimages and found that these stimuli, like real colors, caused preferential activation of V8 but not V4.     

Occipital network for figure/ground organization

To study the cortical mechanism of figure/ground categorization in the human brain, we employed fMRI and the temporal-asynchrony paradigm. This paradigm is able to eliminate any differential activation for local stimulus features, and thus to identify only global perceptual interactions. Strong segmentation of the image into different spatial configurations was generated solely from temporal asynchronies between zones of homogeneous dynamic noise. The figure/ground configuration was a single geometric figure enclosed in a larger surround region. In a control condition, the figure/ground organization was eliminated by segmenting the noise field into many identical temporal-asynchrony stripes. The manipulation of the type of perceptual organization triggered dramatic reorganization in the cortical activation pattern. The figure/ground configuration generated suppression of the ground representation (limited to early retinotopic visual cortex, V1 and V2) and strong activation in the motion complex hMT+/V5+; conversely, both responses were abolished when the figure/ground organization was eliminated. These results suggest that figure/ground processing is mediated by top-down suppression of the ground representation in the earliest visual areas V1/V2 through a signal arising in the motion complex. We propose a model of a recurrent cortical architecture incorporating suppressive feedback that operates in a topographic manner, forming a figure/ground categorization network distinct from that for “pure” scene segmentation and thus underlying the perceptual organization of dynamic scenes into cognitively relevant components. Electronic supplementary material  The online version of this article (doi:) contains supplementary material, which is available to authorized users.     

Visual responses of the human superior colliculus: a high-resolution functional magnetic resonance imaging study

The superior colliculus (SC) is a multimodal laminar structure located on the roof of the brain stem. The SC is a key structure in a distributed network of areas that mediate saccadic eye movements and shifts of attention across the visual field and has been extensively studied in nonhuman primates. In humans, it has proven difficult to study the SC with functional MRI (fMRI) because of its small size, deep location, and proximity to pulsating vascular structures. Here, we performed a series of high-resolution fMRI studies at 3 T to investigate basic visual response properties of the SC. The retinotopic organization of the SC was determined using the traveling wave method with flickering checkerboard stimuli presented at different polar angles and eccentricities. SC activations were confined to stimulation of the contralateral hemifield. Although a detailed retinotopic map was not observed, across subjects, the upper and lower visual fields were represented medially and laterally, respectively. Responses were dominantly evoked by stimuli presented along the horizontal meridian of the visual field. We also measured the sensitivity of the SC to luminance contrast, which has not been previously reported in primates. SC responses were nearly saturated by low contrast stimuli and showed only small response modulation with higher contrast stimuli, indicating high sensitivity to stimulus contrast. Responsiveness to stimulus motion in the SC was shown by robust activations evoked by moving versus static dot stimuli that could not be attributed to eye movements. The responses to contrast and motion stimuli were compared with those in the human lateral geniculate nucleus. Our results provide first insights into basic visual responses of the human SC and show the feasibility of studying subcortical structures using high-resolution fMRI.     

Metamers of the ventral stream

The human capacity to recognize complex visual patterns emerges in a sequence of brain areas known as the ventral stream, beginning with primary visual cortex (V1). We developed a population model for mid-ventral processing, in which nonlinear combinations of V1 responses are averaged in receptive fields that grow with eccentricity. To test the model, we generated novel forms of visual metamers, stimuli that differ physically but look the same. We developed a behavioral protocol that uses metameric stimuli to estimate the receptive field sizes in which the model features are represented. Because receptive field sizes change along the ventral stream, our behavioral results can identify the visual area corresponding to the representation. Measurements in human observers implicate visual area V2, providing a new functional account of neurons in this area. The model also explains deficits of peripheral vision known as crowding, and provides a quantitative framework for assessing the capabilities and limitations of everyday vision.     

Rapid and precise retinotopic mapping of the visual cortex obtained by voltage-sensitive dye imaging in the behaving monkey

Retinotopy is a fundamental organizing principle of the visual cortex. Over the years, a variety of techniques have been used to examine it. None of these techniques, however, provides a way to rapidly characterize retinotopy, at the submillimeter range, in alert, behaving subjects. Voltage-sensitive dye imaging (VSDI) can be used to monitor neuronal population activity at high spatial and temporal resolutions. Here we present a VSDI protocol for rapid and precise retinotopic mapping in the behaving monkey. Two monkeys performed a fixation task while thin visual stimuli swept periodically at a high speed in one of two possible directions through a small region of visual space. Because visual space is represented systematically across the cortical surface, each moving stimulus produced a traveling wave of activity in the cortex that could be precisely measured with VSDI. The time at which the peak of the traveling wave reached each location in the cortex linked this location with its retinotopic representation. We obtained detailed retinotopic maps from a region of about 1 cm(2) over the dorsal portion of areas V1 and V2. Retinotopy obtained during <4 min of imaging had a spatial precision of 0.11-0.19 mm, was consistent across experiments, and reliably predicted the locations of the response to small localized stimuli. The ability to rapidly obtain precise retinotopic maps in behaving monkeys opens the door for detailed analysis of the relationship between spatiotemporal dynamics of population responses in the visual cortex and perceptually guided behavior.     

Retinotopic organization of extra-retinal saccade-related input to the visual cortex in the cat

Summary Single unit activity of 842 cells has been recorded in cat visual cortex and analyzed with respect to vestibular induced, and spontaneous saccadic eye movements performed in the dark. This study has been done in awake, chronically implanted cats, subsequently placed in acute conditions to achieve the precise retinotopic mapping of the cortical areas previously investigated.In areas 17 and 18, respectively, 27% and 24% of the cells tested were influenced by horizontal saccadic eye movements in the dark (E. M. cells). In the Clare-Bishop area, the proportion of E. M. cells was 12%, while only 2% of such cells were found in areas 19 and 21.The distribution of E.M. cells in areas 17 and 18 with respect to retinotopy showed that E.M. cells were more numerous in the cortical zones devoted to the representation of the area centralis (38% in area 17, 27% in area 18) than in the zones subserving the periphery of the visual field (17% and 12%, respectively).Two of the characteristics of E. M. cell activations appear dependant on the retinotopic organization. First, a larger number of E.M. cells presenting an asymmetry in their responses to horizontal saccadic eye movements in opposite directions (directional E.M. cells) were encountered in the cortical representation of the peripheral visual field. 53% of E. M. cells recorded in area 17 and 71% in area 18 were directional in the cortex corresponding to the peripheral visual field. This percentage was of 23% and 25% respectively in the cortex devoted to area centralis. Second, E.M. cells were found to have a latency from the onset of the saccade systematically larger than 100 ms (i.e, they discharged at, or after the end of the eye movement) if they were located in the cortical representation of the area centralis, while E.M. cells related to the peripheral visual field displayed a wider range of latencies (0–240 ms).Results obtained in Clare Bishop area, although limited to the representation of the peripheral visual field, were quantitatively and qualitatively similar to those observed in the homologous retinotopic zones of areas 17 and 18.It is concluded that an extra-retinal input related to oculomotor activity is sent to the cat visual cortex and is organized, at least in areas 17 and 18, with respect to the retinotopic representation of the visual field. These data support the hypothesis of a functional duality between central and peripheral vision and are discussed in the context of visual-oculomotor integration.Supported by INSERM (C.R.L. 79-53336)     

The effects of inverting prisms on the horizontal–vertical illusion: a systematic effect of downward gaze

The purpose of this work is to compare the relative contributions from the extraocular and sensory systems on the magnitude of the horizontal–vertical illusion (HVI). The visual HVI refers to the general tendency to overestimate vertical extensions of small-scale lines on a picture plane relative to the horizontal by 4–16% depending on the method of measurement. The HVI line stimuli consisted of luminous vertical and horizontal lines forming “L-profiles” located in the frontoparallel plane at a 45 cm viewing distance, collinearly with a binocular gaze. The home position of gaze was aligned to the center of the screen with the ear–eye angle concordant with the environmental horizontal. Illusion strength was quantified when subjects fixated the HVI line stimuli in four quadrants of the visual field. The HVI was also viewed through prism lenses that inverted the retinal images by 180°, thereby dissociating the sensory “up-down” direction from the oculomotor up-down frame of reference. The results revealed a systematically lower magnitude of the HVI in the bottom visual field regardless of whether subjects fixated the HVI with the distorting prisms or without. Taken together, these results suggest that the HVI is sensitive to small-angle gaze shifts. In agreement with several recent findings, these results are interpreted as implying that the brain imposes an enhanced analytic structure on the ascending sensory information during downward gaze. Hans O. Richter and Jaanus Raudsepp contributed equally to this work.     

A dynamic fMRI study of illusory double-flash effect on human visual cortex

Functional MRI (fMRI) combined with the paired-stimuli paradigms (referred as dynamic fMRI) was used to study the “illusory double-flash” effect on brain activity in the human visual cortex. Three experiments were designed. The first two experiments aimed to examine the cross-modal neural interaction between the visual and auditory sensory systems caused by the illusory double-flash effect using combined auditory (beep sound) and visual (light flash) stimuli. The fMRI signal in the visual cortex was significantly increased in response to the illusory double flashes compared to the physical single flash when the inter-stimuli delay between the auditory and visual stimuli was 25 ms. This increase disappeared when the delay was prolonged to ~300 ms. These results reveal that the illusory double-flash effect can significantly affect the brain activity in the visual cortex, and the degree of this effect is dynamically sensitive to the inter-stimuli delay. The third experiment was to address the spatial differentiation of brain activation in the visual cortex in response to the illusory double-flash stimulation. It was found that the illusory double-flash effect in the human visual cortex is much stronger in the periphery than the fovea. This finding suggests that the periphery may be involved in high-level brain processing beyond the retinotopic visual perception. The behavioral measures conducted in this study indicate an excellent correlation between the fMRI results and behavioral performance. Finally, this work demonstrates a unique merit of fMRI for providing both temporal and spatial information regarding cross-modal neural interaction between different sensory systems.     

Transcranial magnetic stimulation in the visual system. II. Characterization of induced phosphenes and scotomas

Transcranial magnetic stimulation (TMS) induces phosphenes and disrupts visual perception when applied over the occipital pole. Both the underlying mechanisms and the brain structures involved are still unclear. In the first part of this study we show that the masking effect of TMS differs to masking by light in terms of the psychometric function. Here we investigate the emergence of phosphenes in relation to perimetric measurements. The coil positions were measured with a stereotactic positioning device, and stimulation sites were characterized in four subjects on the basis of individual retinotopic maps measured by with functional magnetic resonance imaging. Phosphene thresholds were found to lie a factor of 0.59 below the stimulation intensities required to induce visual masking. They covered the segments in the visual field where visual suppression occurred with higher stimulation intensity. Both phosphenes and transient scotomas were found in the lower visual field in the quadrant contralateral to the stimulated hemisphere. They could be evoked from a large area over the occipital pole. Phosphene contours and texture remained quite stable with different coil positions over one hemisphere and did not change with the retinotopy of the different visual areas on which the coil was focused. They cannot be related exclusively to a certain functionally defined visual area. It is most likely that both the optic radiation close to its termination in the dorsal parts of V1 and back-projecting fibers from V2 and V3 back to V1 generate phosphenes and scotomas.     

Sensory dominance in combinations of audio,visual and haptic stimuli

Participants presented with auditory, visual, or bi-sensory audio–visual stimuli in a speeded discrimination task, fail to respond to the auditory component of the bi-sensory trials significantly more often than they fail to respond to the visual component—a ‘visual dominance’ effect. The current study investigated further the sensory dominance phenomenon in all combinations of auditory, visual and haptic stimuli. We found a similar visual dominance effect also in bi-sensory trials of combined haptic–visual stimuli, but no bias towards either sensory modality in bi-sensory trials of haptic–auditory stimuli. When presented with tri-sensory trials of combined auditory–visual–haptic stimuli, participants made more errors of responding only to two corresponding sensory signals than errors of responding only to a single sensory modality, however, there were no biases towards either sensory modality (or sensory pairs) in the distribution of both types of errors (i.e. responding only to a single stimulus or to pairs of stimuli). These results suggest that while vision can dominate both the auditory and the haptic sensory modalities, it is limited to bi-sensory combinations in which the visual signal is combined with another single stimulus. However, in a tri-sensory combination when a visual signal is presented simultaneously with both the auditory and the haptic signals, the probability of missing two signals is much smaller than of missing only one signal and therefore the visual dominance disappears.     

The role of human extra-striate visual areas V5/MT and V2/V3 in the perception of the direction of global motion: a transcranial magnetic stimulation study

Several published single case studies reveal a double dissociation between the effects of brain damage in separate extra-striate cortical visual areas on the perception of global visual motion defined by a difference in luminance (first-order motion) versus motion defined by a difference in contrast (second-order motion). In particular, the medial extrastriate cortical region V2/V3 seems to be crucial for the perception of first-order motion, but not for second-order, whereas a lateral and more anterior portion of the cortex close to the temporo–parieto–occipital junction (in the territory of the human motion area hV5/MT⁺) seems to be essential only for the perception of second-order motion. In order to test the hypothesis of a functional specialization of different visual areas for different types of motion, we applied repetitive transcranial magnetic stimulation (rTMS) unilaterally over areas V2/V3, V5/MT, or posterior parietal cortex (PPC) while subjects performed a 2AFC task with first- or second-order global motion displays in the contralateral visual field. Results showed a comparable disruption of the two types of motion, with both rTMS over V2/V3 or over MT/V5, and little or no effect with rTMS over PPC. The results suggest that either the previous psychophysical results with neurological patients are incorrect (highly unlikely) or that the lateral and medial regions are directly connected (as they are in macaque monkeys) such that stimulating one automatically affects the other, in this instance disruptively     

Cognitive mechanisms of transitive inference

Objects in natural scenes are rarely seen in isolation, but are usually overlapping or partially occluding other objects. To recognize individual objects, the visual system must be able to segregate overlapping objects from one another. Evidence from lesions in humans and monkeys suggest that perceptual segregation of occluded or overlapping objects involves extrastriate visual cortex. In monkeys, area V4 has been shown to play an important role in recognizing occluded or poorly salient shapes. In humans, a retinotopic homologue of ventral V4 (V4v) has been described, but it is not known whether this area is also functionally homologous to area V4 in monkeys. In this study, we tried to localize the visual cortical regions involved in perceptual segregation of overlapping shapes using positron emission tomography (PET). Regional cerebral blood flow (rCBF) was measured in seven subjects while they discriminated the relative areas of simultaneously presented rectangular shapes. In the control condition, the shapes were displayed without overlaps; in a second condition, the shapes overlapped each other partially. In a third condition, the shapes did not overlap but had been reduced in salience by adding random noise to the stimuli. Contrasting the overlapping shape condition with the control condition identified a single region in the left posterior lateral occipital cortex. The rCBF in this region also increased, though more weakly, during discrimination of shapes embedded in noise, relative to the control condition. The region activated by segregation of overlapping shapes was located in the posterior occipital cortex close to the anterior border of area V2, near the average location of human V4v as determined by retinotopic mapping studies. The activation of this region of extrastriate visual cortex by a task that involved segregation of overlapping shapes is consistent with monkey V4 and human V4v being functionally homologous. We conclude that discrimination of overlapping shapes involves in particular a region of extrastriate visual cortex located in the left lateral occipital cortex and that this region may correspond to human V4v.     

Representation of the visual field in the optic tract and optic chiasma of the cat

Summary The fibre arrangement in the optic chiasma (OC) and tract (OT) was investigated with anatomical and physiological methods. In silver impregnated material, principal fibre streams can be demonstrated. In the OC, fibre bundles from each eye cross in a regular basket weave pattern, but deviations of single fibres from the predominant stream are often seen. In the OT, fibres run essentially parallel, and crossings of individual fibres are mainly restricted to the periphery of the tract, or around capillaries. Fibres in the upper segment of the OT are of thin, in the lower segments of thick diameter. Individual fibres labelled by HRP injected in the lateral geniculate body (LGB) run essentially parallel over long distances. Ventromedially to the LGB, bifurcations are found with one branch entering the LGB, the other continuing. 57% of OT-fibres had a receptive field (RF) in the contralateral, 43s% in the homolateral eye; 60% in the lower, 40% in the upper visual field; and 6% had a RF in the homolateral visual field, mostly near the vertical meridian. Fibres from the central area were underrepresented in our sample. Fibres from the two eyes were mixed. The RFs of consecutively recorded fibres showed a systematic progression only exceptionally. After plotting RFs of a single penetration on a transformed isodensity ganglion cell map of the visual field, the RF's were distributed along elongated paths on this map. In the OT, such paths ran parallel or slightly inclined relative to the horizontal meridian. They were restricted to either the upper or the lower quadrant or to a path along the horizontal meridian. In the OC, the RF-paths mostly crossed the horizontal meridian at an obtuse angle (average 70 °). Thus, the visual field representation rotates by nearly 90 ° from the OC to the OT. In the OC, the central area is located anteriorly, in the OT dorsally, with the upper visual quadrant laterally and the lower medially. Fibres from the two eyes were mixed and, within the range of the scatter, RFs from the homo- and contralateral eye were in register. It is concluded, that the distribution of fibres in the OC and the OT show a basic retinotopic organization superimposed by scatter.     

An oblique effect in human primary visual cortex

Visual perception critically depends on orientation-specific signals that arise early in visual processing. Humans show greater behavioral sensitivity to gratings with horizontal or vertical (0 degrees /90 degrees; 'cardinal') orientations than to other, 'oblique' orientations. Here we used functional magnetic resonance imaging (fMRI) to measure an asymmetry in the responses of human primary visual cortex (V1) to oriented stimuli. We found that neural responses in V1 were larger for cardinal stimuli than for oblique (45 degrees /135 degrees ) stimuli. Thus the fMRI pattern in V1 closely resembled subjects' behavioral judgments; responses in V1 were greater for those orientations that yielded better perceptual performance.     

Uncertainty and invariance in the human visual cortex

The way in which input noise perturbs the behavior of a system depends on the internal processing structure of the system. In visual psychophysics, there is a long tradition of using external noise methods (i.e., adding noise to visual stimuli) as tools for system identification. Here, we demonstrate that external noise affects processing of visual scenes at different cortical areas along the human ventral visual pathway, from retinotopic regions to higher occipitotemporal areas implicated in visual shape processing. We found that when the contrast of the stimulus was held constant, the further away from the retinal input a cortical area was the more its activity, as measured with functional magnetic resonance imaging (fMRI), depended on the signal-to-noise ratio (SNR) of the visual stimulus. A similar pattern of results was observed when trials with correct and incorrect responses were analyzed separately. We interpret these findings by extending signal detection theory to fMRI data analysis. This approach reveals the sequential ordering of decision stages in the cortex by exploiting the relation between fMRI response and stimulus SNR. In particular, our findings provide novel evidence that occipitotemporal areas in the ventral visual pathway form a cascade of decision stages with increasing degree of signal uncertainty and feature invariance.     

Large-scale remapping of visual cortex is absent in adult humans with macular degeneration

The occipital lobe contains retinotopic representations of the visual field. The representation of the central retina in early visual areas (V1-3) is found at the occipital pole. When the central retina is lesioned in both eyes by macular degeneration, this region of visual cortex at the occipital pole is accordingly deprived of input. However, even when such lesions occur in adulthood, some visually driven activity in and around the occipital pole can be observed. It has been suggested that this activity is a result of remapping of this area so that it now responds to inputs from intact, peripheral retina. We evaluated whether or not remapping of visual cortex underlies this activity. Our functional magnetic resonance imaging results provide no evidence of remapping, questioning the contemporary view that early visual areas of the adult human brain have the capacity to reorganize extensively.