Cognitive mechanisms of transitive inference

Objects in natural scenes are rarely seen in isolation, but are usually overlapping or partially occluding other objects. To recognize individual objects, the visual system must be able to segregate overlapping objects from one another. Evidence from lesions in humans and monkeys suggest that perceptual segregation of occluded or overlapping objects involves extrastriate visual cortex. In monkeys, area V4 has been shown to play an important role in recognizing occluded or poorly salient shapes. In humans, a retinotopic homologue of ventral V4 (V4v) has been described, but it is not known whether this area is also functionally homologous to area V4 in monkeys. In this study, we tried to localize the visual cortical regions involved in perceptual segregation of overlapping shapes using positron emission tomography (PET). Regional cerebral blood flow (rCBF) was measured in seven subjects while they discriminated the relative areas of simultaneously presented rectangular shapes. In the control condition, the shapes were displayed without overlaps; in a second condition, the shapes overlapped each other partially. In a third condition, the shapes did not overlap but had been reduced in salience by adding random noise to the stimuli. Contrasting the overlapping shape condition with the control condition identified a single region in the left posterior lateral occipital cortex. The rCBF in this region also increased, though more weakly, during discrimination of shapes embedded in noise, relative to the control condition. The region activated by segregation of overlapping shapes was located in the posterior occipital cortex close to the anterior border of area V2, near the average location of human V4v as determined by retinotopic mapping studies. The activation of this region of extrastriate visual cortex by a task that involved segregation of overlapping shapes is consistent with monkey V4 and human V4v being functionally homologous. We conclude that discrimination of overlapping shapes involves in particular a region of extrastriate visual cortex located in the left lateral occipital cortex and that this region may correspond to human V4v.     

Rapid and precise retinotopic mapping of the visual cortex obtained by voltage-sensitive dye imaging in the behaving monkey

Retinotopy is a fundamental organizing principle of the visual cortex. Over the years, a variety of techniques have been used to examine it. None of these techniques, however, provides a way to rapidly characterize retinotopy, at the submillimeter range, in alert, behaving subjects. Voltage-sensitive dye imaging (VSDI) can be used to monitor neuronal population activity at high spatial and temporal resolutions. Here we present a VSDI protocol for rapid and precise retinotopic mapping in the behaving monkey. Two monkeys performed a fixation task while thin visual stimuli swept periodically at a high speed in one of two possible directions through a small region of visual space. Because visual space is represented systematically across the cortical surface, each moving stimulus produced a traveling wave of activity in the cortex that could be precisely measured with VSDI. The time at which the peak of the traveling wave reached each location in the cortex linked this location with its retinotopic representation. We obtained detailed retinotopic maps from a region of about 1 cm(2) over the dorsal portion of areas V1 and V2. Retinotopy obtained during <4 min of imaging had a spatial precision of 0.11-0.19 mm, was consistent across experiments, and reliably predicted the locations of the response to small localized stimuli. The ability to rapidly obtain precise retinotopic maps in behaving monkeys opens the door for detailed analysis of the relationship between spatiotemporal dynamics of population responses in the visual cortex and perceptually guided behavior.     

Uniform spatial spread of population activity in primate parafoveal V1

What are the shape and size of the region in primate V1 that processes information from a single point in visual space? This region, a fundamental property termed cortical point image (CPI) (McIlwain 1986), represents the minimal population of V1 neurons that can be activated by a visual stimulus and therefore has important implications for population coding in the cortex. Previous indirect attempts to measure the CPI in macaque V1 using sparse microelectrode recordings resulted in conflicting findings. Whereas some early studies suggested that CPI size is constant throughout V1 (e.g., Hubel and Wiesel 1974), others have reported large changes in CPI size in parafoveal V1 (e.g., Van Essen et al. 1984). To resolve this controversy, we used voltage-sensitive dye imaging in V1 of fixating monkeys to directly measure the subthreshold CPI and several related properties across a range of parafoveal eccentricities. We found that despite large changes in other properties of the retinotopic map, the subthreshold CPI is approximately constant and extends over ～6 × 8 mm(2). This large and invariant CPI ensures a uniform representation of each point in visual space, with a complete representation of all visual features in V1, as originally proposed by Hubel and Wiesel (1974). In addition, we found several novel and unexpected asymmetries and anisotropies in the shapes of the CPI and the population receptive field. These results expand our understanding of the representation of visual space in V1 and are likely to be relevant for the representations of stimuli in other sensory cortical areas.     

A comparison of magnification functions in area 19 and the lateral suprasylvian visual area in the cat

A retinotopic map can be described by a magnification function that relates magnification factor to visual field eccentricity. Magnification factor for primary visual cortex (VI) in both the cat and the macaque monkey is directly proportional to retinal ganglion cell density. However, among those extrastriate areas for which a magnification function has been described, this is often not the case. Deviations from the pattern established in V1 are of considerable interest because they may provide insight into an extrastriate area's role in visual processing. The present study explored the magnification function for the lateral suprasylvian area (LS) in the cat. Because of its complex retinotopic organization, magnification was calculated indirectly using the known magnification function for area 19. Small tracer injections were made in area 17, and the extent of anterograde label in LS and in area 19 was measured. Using the ratio of cortical area labeled in LS to that in area 19, and the known magnification factor for area 19 at the corresponding retinotopic location, we were able to calculate magnification factor for LS. We found that the magnification function for LS differed substantially from that for area 19: central visual field was expanded, and peripheral field compressed in LS compared with area 19. Additionally, we found that the lower vertical meridian's representation was compressed relative to that of the horizontal meridian. We also examined receptive field size in areas 17, 19, and LS and found that, for all three areas, receptive field size was inversely proportional to magnification factor.     

Functional magnetic resonance imaging of synesthesia: activation of V4/V8 by spoken words

In 'colored-hearing' synesthesia, individuals report color experiences when they hear spoken words. If the synesthetic color experience resembles that of normal color perception, one would predict activation of parts of the visual system specialized for such perception, namely the human 'color center', referred to as either V4 or V8. Using functional magnetic resonance imaging (fMRI), we here locate the region activated by speech in synesthetes to area V4/V8 in the left hemisphere, and demonstrate overlap with V4/V8 activation in normal controls in response to color. No activity was detected in areas V1 or V2, suggesting that activity in primary visual cortex is not necessary for such experience. Control subjects showed no activity in V4/V8 when imagining colors in response to spoken words, despite overtraining on word-color associations similar to those spontaneously reported by synesthetes.     

Impairments in spatial generalization of visual skills after V4 and TEO lesions in macaques (Macaca mulatta)

The authors tested the spatial generalization of shape and color discriminations in 2 monkeys, in which 3 visual field quadrants were affected, respectively, by lesions in area V4, TEO, or both areas combined. The fourth quadrant served as a normal control. The monkeys were trained to discriminate stimuli presented in a standard location in each quadrant, followed by tests of discrimination performance in new locations in the same quadrant. In the quadrant affected by the V4 + TEO lesion, the authors found temporary but striking deficits in spatial generalization of shape and color discriminations over small distances, suggesting a contribution of areas V4 and TEO to short-range spatial generalization of visual skills.     

Cortical activation during color discrimination task in macaques as revealed by positron emission tomography

Physiological and lesion studies have shown that the anterior inferior temporal (IT) cortex (aITC) is involved in the color vision of macaque monkeys. However, some functional imaging studies using awake monkeys contradicted the involvement of aITC in color vision. Thus, in most of the imaging studies, cortical activation has been observed during a fixation task. However, because the neuronal activity of aITC is highly affected by the behavioral task, it is desirable to investigate cortical activity during a color discrimination task to determine the functional role of aITC in the color vision of macaque monkeys. In this study, we investigated the cortical activity of aITC of macaque monkeys during color discrimination by positron emission tomography. Two monkeys were trained in a color discrimination task. Cortical areas involved in color processing were investigated by comparing activities during the color discrimination and lever release tasks. In addition to area V4 and the posterior IT cortex (pITC), we found color-related activities in the anterior IT gyrus. Consistent activation was observed in the region posterior to the anterior medial temporal sulcus (AMTS), although the exact location and the size of activations differed between monkeys and hemispheres. We also found color-related activities in the anterior portion of the superior temporal sulcus (STS), suggesting its involvement in the color vision. The present results revealed that aITC is involved in the color vision of macaque monkeys by a functional imaging technique.     

Stimulus dependence of disparity coding in primate visual area V4

Disparity tuning in visual cortex has been shown using a variety of stimulus types that contain stereoscopic depth cues. It is not known whether different stimuli yield similar disparity tuning curves. We studied whether cells in visual area V4 of the macaque show similar disparity tuning profiles when the same set of disparity values were tested using bars or dynamic random dot stereograms, which are among the most commonly used stimuli for this purpose. In a majority of V4 cells (61%), the shape of the disparity tuning profile differed significantly for the two stimulus types. The two sets of stimuli yielded statistically indistinguishable disparity tuning profiles for only a small minority (6%) of V4 cells. These results indicate that disparity tuning in V4 is stimulus-dependent. Given the fact that bar stimuli contain two-dimensional (2-D) shape cues, and the random dot stereograms do not, our results also indicate that V4 cells represent 2-D shape and binocular disparity in an interdependent fashion, revealing an unexpected complexity in the analysis of depth and three-dimensional shape.     

Differential contribution of early visual areas to the perceptual process of contour processing

We investigated contour processing and figure-ground detection within human retinotopic areas using event-related functional magnetic resonance imaging (fMRI) in 6 healthy and na?ve subjects. A figure (6 degrees side length) was created by a 2nd-order texture contour. An independent and demanding foveal letter-discrimination task prevented subjects from noticing this more peripheral contour stimulus. The contour subdivided our stimulus into a figure and a ground. Using localizers and retinotopic mapping stimuli we were able to subdivide each early visual area into 3 eccentricity regions corresponding to 1) the central figure, 2) the area along the contour, and 3) the background. In these subregions we investigated the hemodynamic responses to our stimuli and compared responses with or without the contour defining the figure. No contour-related blood oxygenation level-dependent modulation in early visual areas V1, V3, VP, and MT+ was found. Significant signal modulation in the contour subregions of V2v, V2d, V3a, and LO occurred. This activation pattern was different from comparable studies, which might be attributable to the letter-discrimination task reducing confounding attentional modulation. In V3a, but not in any other retinotopic area, signal modulation corresponding to the central figure could be detected. Such contextual modulation will be discussed in light of the recurrent processing hypothesis and the role of visual awareness.     

Functional organization for color and orientation in macaque V4

Visual area V4 in the macaque monkey is a cortical area that is strongly involved in color and shape perception. However, fundamental questions about V4 are still debated. V4 was initially characterized as a color-processing area, but subsequent studies revealed that it contains a diverse complement of cells, including those with preference for color, orientation, disparity and higher-order feature preferences. This has led to disputes and uncertainty about the role of V4 in vision. Using intrinsic signal optical imaging methods in awake, behaving monkeys, we found that different feature preferences are functionally organized in V4. Optical images revealed that regions with preferential response to color were largely separate from orientation-selective regions. Our results help to resolve long-standing controversies regarding functional diversity and retinotopy in V4 and indicate the presence of spatially biased distribution of featural representation in V4 in the ventral visual pathway.     

Differential human brain activation by vertical and horizontal global visual textures

Mid-level visual processes which integrate local orientation information for the detection of global structure can be investigated using global form stimuli of varying complexity. Several lines of evidence suggest that the identification of concentric and parallel organisations relies on different underlying neural substrates. The current study measured brain activation by concentric, horizontal parallel, and vertical parallel arrays of short line segments, compared to arrays of randomly oriented segments. Six subjects were scanned in a blocked design functional magnetic resonance imaging experiment. We compared percentage BOLD signal change during the concentric, horizontal and vertical blocks within early retinotopic areas, the fusiform face area and the lateral occipital complex. Unexpectedly, we found that vertical and horizontal parallel forms differentially activated visual cortical areas beyond V1, but in general, activations to concentric and parallel forms did not differ. Vertical patterns produced the highest percentage signal change overall and only area V3A showed a significant difference between concentric and parallel (horizontal) stimuli, with the former better activating this area. These data suggest that the difference in brain activation to vertical and horizontal forms arises at intermediate or global levels of visual representation since the differential activity was found in mid-level retinotopic areas V2 and V3 but not in V1. This may explain why earlier studies—using methods that emphasised responses to local orientation—did not discover this vertical–horizontal anisotropy.     

Space coding by premotor cortex

Summary Many neurons in inferior area 6, a cortical premotor area, respond to visual stimuli presented in the space around the animal. We were interested to learn whether the receptive fields of these neurons are coded in retinotopic or in body-centered coordinates. To this purpose we recorded single neurons from inferior area 6 (F4 sector) in a monkey trained to fixate a light and detect its dimming. During fixation visual stimuli were moved towards the monkey both within and outside the neurons's receptive field. The fixation point was then moved and the neuron retested with the monkey's gaze deviated to the new location. The results showed that most inferior area 6 visual neurons code the stimulus position in spatial and not in retinal coordinates. It is proposed that these visual neurons are involved in generating the stable body-centered frame of reference necesary for programming visually guided movements.     

Parietal representation of object-based saccades

When monkeys make saccadic eye movements to simple visual targets, neurons in the lateral intraparietal area (LIP) display a retinotopic, or eye-centered, coding of the target location. However natural saccadic eye movements are often directed at objects or parts of objects in the visual scene. In this paper we investigate whether LIP represents saccadic eye movements differently when the target is specified as part of a visually displayed object. Monkeys were trained to perform an object-based saccade task that required them to make saccades to previously cued parts of an abstract object after the object reappeared in a new orientation. We recorded single neurons in area LIP of two macaque monkeys and analyzed their activity in the object-based saccade task, as well as two control tasks: a standard memory saccade task and a fixation task with passive object viewing. The majority of LIP neurons that were tuned in the memory saccade task were also tuned in the object-based saccade task. Using a hierarchical generalized linear model analysis, we compared the effects of three different spatial variables on the firing rate: the retinotopic location of the target, the object-fixed location of the target, and the orientation of the object in space. There was no evidence of an explicit object-fixed representation in the activity in LIP during either of the object-based tasks. In other words, no cells had receptive fields that rotated with the object. While some cells showed a modulation of activity due to the location of the target on the object, these variations were small compared to the retinotopic effects. For most cells, firing rates were best accounted for by either the retinotopic direction of the movement, the orientation of the object, or both spatial variables. The preferred direction of these retinotopic and object orientation effects were found to be invariant across tasks. On average, the object orientation effects were consistent with the retinotopic coding of potential target locations on the object. This interpretation is supported by the fact that the magnitude of these two effects were roughly equal in the early portions of the trial, but around the time of the motor response, the retinotopic effects dominated. We conclude that LIP uses the same retinotopic coding of saccade target whether the target is specified as an absolute point in space or as a location on a moving object.     

Physiological correlates of perceptual learning in monkey V1 and V2

Performance in visual discrimination tasks improves with practice. Although the psychophysical parameters of these improvements have suggested the involvement of early areas in visual cortex, there has been little direct study of the physiological correlates of such perceptual learning at the level of individual neurons. To examine how neuronal response properties in the early visual system may change with practice, we trained monkeys for more than 6 mo in an orientation discrimination task in which behaviorally relevant stimuli were restricted to a particular retinal location and oriented around a specific orientation. During training the monkeys' discrimination thresholds gradually improved to much better than those of naive monkeys or humans. Although this improvement was specific to the trained orientation, it showed little retinotopic specificity. The receptive field properties of single neurons from regions representing the trained location and a location in the opposite visual hemifield were measured in V1 and V2. In most respects the receptive field properties in the representations of the trained and untrained regions were indistinguishable. However, in the regions of V1 and V2 representing the trained location, there were slightly fewer neurons whose optimal orientation was near the trained orientation. This resulted in a small but significant decrease in the V1 population response to the trained orientation at the trained location. Consequently, the observed neuronal populations did not exhibit any orientation-specific biases sufficient to explain the orientation specificity of the behavioral improvement. Pooling models suggest that the behavioral improvement was accomplished with a task-dependent and orientation-selective pooling of unaltered signals from early visual neurons. These data suggest that, even for training with stimuli suited to the selectivities found in early areas of visual cortex, behavioral improvements can occur in the absence of pronounced changes in the physiology of those areas.     

Dynamics of response to perceptual pop-out stimuli in macaque V1

Contextual modulation due to feature contrast between the receptive field and surrounding region has been reported for numerous stimuli in primary visual cortex. One type of this modulation, iso-orientation surround suppression, has been studied extensively. The degree to which surround suppression is related to other forms of contextual modulation remains unknown. We used shape-from-shading stimuli in a field of distractors to test the latency and magnitude of contextual modulation to a stimulus that cannot be distinguished with an orientation-selective mechanism. This stimulus configuration readily elicits perceptual pop-out in human observers and induces a long-latency contextual modulation response in neurons in macaque early visual cortex. We found that animals trained to detect the location of a pop-out stimulus were better at finding a sphere that appeared to be lit from below in the presence of distractors that were lit from above. Furthermore, neuronal responses were stronger and had shorter latency in the condition where behavioral performance was best. This asymmetry is compatible with earlier psychophysical findings in human observers. In the population of V1 neurons, the latency of the contextual modulation response is 145 ms on average (ranging from 70 to 230 ms). This is much longer than the latency for iso-orientation surround suppression, indicating that the underlying circuitry is distinct. Our results support the idea that a feature-specific feedback signal generates the pop-out responses we observe and suggest that V1 neurons actively participate in the computation of perceptual salience.     

Spatially specific FMRI repetition effects in human visual cortex

The functional MRI (fMRI) response to a pair of identical, successively presented stimuli can result in a smaller signal than the presentation of two nonidentical stimuli. This "repetition effect" has become a frequently used tool to make inferences about neural selectivity in specific cortical areas. However, little is known about the mechanism(s) underlying the effect. In particular, despite many successful applications of the technique in higher visual areas, repetition effects in lower visual areas [e.g., primary visual cortex (V1)] have been more difficult to characterize. One property that is well understood in early visual areas is the mapping of visual field locations to specific areas of the cortex (i.e., retinotopy). We used the retinotopic organization of V1 to activate progressively different populations of neurons in a rapid fMRI experimental design. We observed a repetition effect (reduced signal) when localized stimulus elements were repeated in identical locations. We show that this effect is spatially tuned and largely independent of both interstimulus interval (100-800 ms) and the focus of attention. Using the same timing parameters for which we observed a large effect of spatial position, we also examined the response to orientation changes and observed no effect of an orientation change on the response to repeated stimuli in V1 but significant effects in other retinotopic areas. Given these results, we discuss the possible causes of these repetition effects as well as the implications for interpreting other experiments that use this potentially powerful imaging technique.     

Modulation of sensory suppression: implications for receptive field sizes in the human visual cortex

Neurophysiological studies in monkeys show that when multiple visual stimuli appear simultaneously in the visual field, they are not processed independently, but rather interact in a mutually suppressive way. This suggests that multiple stimuli compete for neural representation. Consistent with this notion, we have previously found in humans that functional magnetic resonance imaging (fMRI) signals in V1 and ventral extrastriate areas V2, V4, and TEO are smaller for simultaneously presented (i.e., competing) stimuli than for the same stimuli presented sequentially (i.e., not competing). Here we report that suppressive interactions between stimuli are also present in dorsal extrastriate areas V3A and MT, and we compare these interactions to those in areas V1 through TEO. To exclude the possibility that the differences in responses to simultaneously and sequentially presented stimuli were due to differences in the number of transient onsets, we tested for suppressive interactions in area V4, in an experiment that held constant the number of transient onsets. We found that the fMRI response to a stimulus in the upper visual field was suppressed by the presence of nearby stimuli in the lower visual field. Further, we excluded the possibility that the greater fMRI responses to sequential compared with simultaneous presentations were due to exogeneous attentional cueing by having our subjects count T's or L's at fixation, an attentionally demanding task. Behavioral testing demonstrated that neither condition interfered with performance of the T/L task. Our previous findings suggested that suppressive interactions among nearby stimuli in areas V1 through TEO were scaled to the receptive field (RF) sizes of neurons in those areas. Here we tested this idea by parametrically varying the spatial separation among stimuli in the display. Display sizes ranged from 2 x 2 degrees to 7 x 7 degrees and were centered at 5.5 degrees eccentricity. Based on the effects of display size on the magnitude of suppressive interactions, we estimated that RF sizes at an eccentricity of 5.5 degrees were <2 degrees in V1, 2-4 degrees in V2, 4-6 degrees in V4, larger than 7 degrees (but still confined to a quadrant) in TEO, and larger than 6 degrees (confined to a quadrant) in V3A. These estimates of RF sizes in human visual cortex are strikingly similar to those measured in physiological mapping studies in the homologous visual areas in monkeys.     

The representation of perceived angular size in human primary visual cortex

Two objects that project the same visual angle on the retina can appear to occupy very different proportions of the visual field if they are perceived to be at different distances. What happens to the retinotopic map in primary visual cortex (V1) during the perception of these size illusions? Here we show, using functional magnetic resonance imaging (fMRI), that the retinotopic representation of an object changes in accordance with its perceived angular size. A distant object that appears to occupy a larger portion of the visual field activates a larger area in V1 than an object of equal angular size that is perceived to be closer and smaller. These results demonstrate that the retinal size of an object and the depth information in a scene are combined early in the human visual system.     

Neurons with radial receptive fields in monkey area V4A: evidence of a subdivision of prelunate gyrus based on neuronal response properties

In recordings from two awake, behaving macaque monkeys we found that neurons in the crown of the prelunate gyrus differed in their responsiveness to simple visual stimuli. Neurons in the posterior part of the gyrus (area V4) responded strongly to stationary or moving bars, while neurons in the anterior part (area V4A) responded only weakly to such stimuli. Most receptive fields in area V4A were elongated with long axes oriented radially towards the fovea. These neurons were sensitive to radial movements, especially to sudden shifts of real 3D objects. The border between areas V4 and V4A coincided with the representation of the horizontal meridian. Area V4A extended into the posterior bank of the superior temporal sulcus, where its border corresponded to the representation of the vertical meridian. The sequence of the representations of the horizontal and vertical meridians over the prelunate gyrus suggests the existence of another area between V4A and V4t.