Sensitivity for structure gradient in texture discrimination tasks

Recent experiments indicate that the segregation of visual structures ("texture discrimination") depends not only on the form of texture elements but also on their spacing. Structures with discriminable elements in close proximity can be segregated more easily than patterns in which the same texture elements are more widely spaced. In dot arrays with areas of different dot luminance, segregation was found to depend on both the luminance difference and dot spacing; discrimination of texture areas in coarse dot rasters required greater differences in luminance than in fine rasters. Also, in regular arrays of iso-luminant line patterns, the maximal spacing between neighbouring lines for which different texture areas could still be discriminated was found to be influenced by the degree of dissimilarity between elements. For lines of a given length, texture areas with small differences in orientation became indiscriminable at smaller spacings than texture areas with orthogonal line orientations. Line length additionally had a strong effect on texture discrimination; increasing the line length for a given spacing provided easier segregation of texture areas. However, over a range of raster widths, discrimination of texture areas with a given difference in line orientation varied not with absolute values of line length but with the ratio of line length to interline spacing. Overall, the data suggest that texture discrimination in man is based on the evaluation of variation in structure over space (defined as the "texture gradient"). If local variation of structure is too small, texture areas cannot be discriminated, though differences between texture elements themselves may be apparent. As far as the dependence on variation over space is concerned, discrimination of iso-luminant textures resembles the limited sensitivity of the visual system for differences in texture luminance.     

Temporal resolution of orientation-defined texture segregation: a VEP study

Orientation is one of the visual dimensions that subserve figure-ground discrimination. A spatial gradient in orientation leads to "texture segregation", which is thought to be concurrent parallel processing across the visual field, without scanning. In the visual-evoked potential (VEP) a component can be isolated which is related to texture segregation ("tsVEP"). Our objective was to evaluate the temporal frequency dependence of the tsVEP to compare processing speed of low-level features (e.g., orientation, using the VEP, here denoted llVEP) with texture segregation because of a recent literature controversy in that regard. Visual-evoked potentials (VEPs) were recorded in seven normal adults. Oriented line segments of 0.1 degrees x 0.8 degrees at 100% contrast were presented in four different arrangements: either oriented in parallel for two homogeneous stimuli (from which were obtained the low-level VEP (llVEP)) or with a 90 degrees orientation gradient for two textured ones (from which were obtained the texture VEP). The orientation texture condition was presented at eight different temporal frequencies ranging from 7.5 to 45 Hz. Fourier analysis was used to isolate low-level components at the pattern-change frequency and texture-segregation components at half that frequency. For all subjects, there was lower high-cutoff frequency for tsVEP than for llVEPs, on average 12 Hz vs. 17 Hz (P = 0.017). The results suggest that the processing of feature gradients to extract texture segregation requires additional processing time, resulting in a lower fusion frequency.     

Texture segmentation and pop-out from orientation contrast.

In arrays of oriented lines, a target at a different orientation is effortlessly detected; it "pops out" from the pattern. Similarly, textures with line arrays at different orientations seem to dissect into separate areas with the spontaneous percept of distinct borders between them. In recent models, these perceptual phenomena were linked to the pre-attentive detection of certain features and of first-order differences in their spatial distribution. In contrast, however, psychophysical experiments show that texture segmentation and visual pop-out arise from orientation differences rather than from the orientation features themselves, a view which is supported by neurophysiological data from the monkey visual cortex.     

An exploration of the spatial scale over which orientation-dependent surround effects affect contour detection

Contour detection is a crucial component of visual processing; however, performance on contour detection tasks can vary depending on the context of the visual scene. S. C. Dakin and N. J. Baruch (2009) showed that detection of a contour in an array of distracting elements depends on the orientation of flanking elements. Here, using a line of five collinear Gabor elements ("target contour") in a field of distractor Gabor elements, we systematically measured the effects of eccentricity, spacing, and spatial frequency on contour detection performance in three different contexts: randomly oriented distractors (control condition), flanking distractors (on either side of the collinear Gabors) aligned approximately parallel to the target contour, and flanking distractors aligned approximately orthogonal to the target contour. In the control condition, contour detection performance was best for larger Gabors (2 cpd) spaced farther apart (1.2°). Parallel flankers reduced performance for intermediate and large spacings and sizes compared to the control condition, while orthogonal flankers increased performance for the smallest spacing and size compared to the control condition. The results are fit by a model in which collinear facilitation, which is size-dependent but can persist for several degrees of visual angle, competes with orientation-dependent suppression from the flanking context when elements are separated by less than a degree of visual angle.     

Feature-specific electrophysiological correlates of texture segregation

Discrimination between a figure and its surround is an important first step of pattern recognition. This discrimination usually relies, as a first step, on the detection of borders between a figure and its surround, for example based on spatial gradients in luminance, colour, or texture. There is evidence that neurones in the visual cortex are specifically activated by segregation between textures, but the relation between segregation based on different types of features such as colour, luminance, and motion is unclear. Evoked EEG potentials specific to texture segregation were investigated in 17 observers in two separate experiments and by means of functional magnetic resonance imaging in a separate study (Fahle et al., in preparation). Differences in either luminance, colour, line orientation, motion, or stereoscopic depth defined a checkerboard pattern. Patterns defined by each of these features elicited segregation-specific potentials. In contrast to earlier reports (Vision Research 37 (1997) 1409), however, we find pronounced differences between the segregation-specific potentials evoked through different features, especially regarding their peak latencies. The topographical distribution of the activity evoked reveals different polarities and partly specific locations for different stimulus features, indicating the existence of different processors for texture segregation based on different features.     

Summation of texture segregation across orientation and spatial frequency: electrophysiological and psychophysical findings

Objects are usually segregated from ground by several visual dimensions. We studied texture segregation in checkerboards defined by gradients in spatial frequency, orientation or both frequency and orientation, using Gabor-filtered noise patterns. Saliency was measured electrophysiologically using the visual evoked potential (VEP) associated with texture segregation ('tsVEP') (an associated component in the visual evoked potential), and psychophysically by a 2AFC task. Spatial frequency and orientation stimuli evoked percepts of texture segregation and tsVEPs in all 11 subjects. The tsVEPs to combined stimuli were larger than those to each dimension alone, but smaller (74%) than the algebraic sum of tsVEPs to both individual dimensions. Psychophysical detection rates differed significantly between all conditions (P < 0.001), with highest rates for the combined stimuli. The findings suggest that segregation based on a combination of 'orientation' and 'spatial frequency' is more salient than that based on either of these alone. The significant deviation from full additivity in the tsVEPs suggests that simultaneous contrasts in spatial frequency and orientation have a common processing stage.     

Suppressive and facilitatory spatial interactions in amblyopic vision

Amblyopic vision is characterized by reduced spatial resolution, and inhibitory spatial interactions ("crowding") that extend over long distances. The present paper had three goals: (1) To ask whether the extensive crowding in amblyopic vision is a consequence of a shift in the spatial scale of analysis. To test this we measured the extent of crowding for targets that were limited in their spatial frequency content, over a large range of target sizes and spatial frequencies. (2) To ask whether crowding in amblyopic vision can be explained on the basis of contrast masking by remote flanks. To test this hypothesis we measured and compared crowding in a direction-identification experiment with masking by remote flanks in a detection experiment. In each of the experiments our targets and flanks were comprised of Gabor features, thus allowing us to control the feature contrast, spatial frequency and orientation. (3) To examine the relationship between the suppressive and facilitatory interactions in amblyopic contrast detection and "crowding". Our results show that unlike the normal fovea [Levi, Klein, & Hariharan, Journal of Vision 2 (2002a) 140] crowding in amblyopia is neither scale invariant, nor is it attributable to simple contrast masking. Rather, our results suggest that suppressive spatial interactions in amblyopic vision extend over larger distances than in normal foveal vision, similar to peripheral vision of non-amblyopic observers [Levi, Hariharan, & Klein, Journal of Vision 2 (2002b) 167], for targets of the same size. Observers can easily detect the features that comprise our targets (Gabor patches) under conditions where crowding is strong. Thus, our speculation is that crowding occurs because the target and flanks are combined or pooled at a second stage that is coarse in the amblyopic visual system, following the stage of feature extraction. In amblyopic vision, this pooling takes place over a large spatial distance.     

Neuronal response to texture- and contrast-defined boundaries in early visual cortex

Natural scenes contain a variety of visual cues that facilitate boundary perception (e.g., luminance, contrast, and texture). Here we explore whether single neurons in early visual cortex can process both contrast and texture cues. We recorded neural responses in cat A18 to both illusory contours formed by abutting gratings (ICs, texture-defined) and contrast-modulated gratings (CMs, contrast-defined). We found that if a neuron responded to one of the two stimuli, it also responded to the other. These neurons signaled similar contour orientation, spatial frequency, and movement direction of the two stimuli. A given neuron also exhibited similar selectivity for spatial frequency of the fine, stationary grating components (carriers) of the stimuli. These results suggest that the cue-invariance of early cortical neurons extends to different kinds of texture or contrast cues, and might arise from a common nonlinear mechanism.     

Comparison of different models of orientation selectivity based on distinct intracortical inhibition rules

Aim of this work is to present simple models of orientation selectivity in the visual cortex, which do not require massive computational effort. Three different models are compared, in order to gain deeper insight into the structure of cortical circuits generating inhibitory signals. All models represent a single hypercolumn. They differ as to the arrangement of inhibitory connections: in the first ("antiphase inhibition model") inhibition is in phase opposition with excitation, but with a similar orientation tuning; in the second ("in-phase inhibition model"), inhibition is in phase with excitation, but with larger orientation tuning. In these two models the orientation width of inhibition increases with contrast. Finally, a third model ("center-surround model") assumes that inhibition comes from the same cells providing excitation, hence the inhibition tuning is contrast-independent. All models, with suitable values of the intracortical synapse parameters, are able to mimic experimental results in the literature. A few differences are evident between the "center-surround model" and the other two, especially as to the dependence of cortical cell response on spatial frequency. The models can represent practical tools to test hypotheses on the disposition of cortical synapses avoiding massive computational efforts.     

Segregation of mesh-derived textures evaluated by resistance to added disorder.

In the "figure detection task" the strength of segregation for a particular texture pair was estimated by the threshold amount of added disorder that prevented segregation of a textured figure from a textured ground. Disorder was either jitter in the orientation of the texture elements, or jitter in their xy positions, or a mixture of the two. Other procedures included lowpass filtering, and a task requiring discrimination between textured figures of different shapes. Orientation cues are weakly or inconsistently used for segregating mesh textures. The low spatial harmonics are very important. A new finding is that orientation and position jitter thresholds for a set of figure/ground texture patterns are often proportional. In a mixture the one disorder can be exchanged for the other.     

Texture segregation is processed by primary visual cortex in man and monkey. Evidence from VEP experiments.

We investigated whether the process of texture segregation can be allocated to a specific visual cortical area. We designed a stimulus to reveal the presence of a mechanism, which is specifically sensitive to a checkerboard, that is solely defined by textures segregating due to orientation differences of the constituting line segments. We recorded evoked potentials to this stimulus in man and awake monkey. A difference component, signalling texture segregation sensitivity, could be recorded from both types of subjects. Its presence depended on the spatial extent of the textures, in a manner correlating with the perceptibility of the checkerboard. This difference response could be localized in primary visual cortex by means of equivalent dipole estimations.     

Suppressive and facilitatory spatial interactions in foveal vision: foveal crowding is simple contrast masking

Spatial interactions are a critical and ubiquitous feature of spatial vision. These interactions may be inhibitory (reducing sensitivity as occurs in crowding) or facilitatory (enhancing sensitivity). In this work, we had four goals. 1. To test the hypothesis that foveal crowding depends on target size by measuring the extent of crowding for novel targets that were limited in their spatial frequency content. We used a large range of target sizes and spatial frequencies. 2. To assess whether the critical spatial frequency model (Hess, Dakin, & Kapoor, 2000) provides a general model for foveal crowding. To test this model, we measured crowding for a direction-identification task that did not require judging the orientation of the gap. 3. To test the hypothesis that foveal crowding is simply contrast masking by remote flanks we measured and compared crowding in a direction-identification experiment with masking by remote flanks in a detection experiment. In each of the experiments, our targets and flanks were composed of Gabor features, thus allowing us to control the feature contrast, spatial frequency, and orientation. 4. To assess the relationship between suppressive and facilitatory spatial interactions in foveal vision. Our results show that (1) foveal crowding is proportional to feature size over the more than 50-fold range of target sizes that we examined. Over this large range, foveal crowding is scale invariant. Our results also show it is the size of the envelope (SD) rather than the carrier (SF) that determines the extent of crowding in the fovea. 2. Crowding that occurs in the direction-identification task is quite similar to crowding where orientation information is available. Thus we conclude that the critical spatial frequency model does not provide a general explanation for foveal crowding. 3. Threshold elevation for crowding is similar to threshold elevation for masking as predicted by our test-pedestal model. Thus we conclude that foveal crowding is simple contrast masking. 4. Based on our comparison of threshold changes in crowding and masking, we conclude that in foveal vision, the suppressive spatial interactions due to nearby flanks are similar in the two tasks. However, the facilitatory interactions are quite different. In the crowding task, we find very little evidence for facilitation by flankers, whereas in the detection task, we find strong facilitation. We suggest that facilitation of detection by remote flanks may be, at least in part, a consequence of uncertainty reduction.     

Crowding is unlike ordinary masking: distinguishing feature integration from detection

A letter in the peripheral visual field is much harder to identify in the presence of nearby letters. This is "crowding." Both crowding and ordinary masking are special cases of "masking," which, in general, refers to any effect of a "mask" pattern on the discriminability of a signal. Here we characterize crowding, and propose a diagnostic test to distinguish it from ordinary masking. In ordinary masking, the signal disappears. In crowding, it remains visible, but is ambiguous, jumbled with its neighbors. Masks are usually effective only if they overlap the signal, but the crowding effect extends over a large region. The width of that region is proportional to signal eccentricity from the fovea and independent of signal size, mask size, mask contrast, signal and mask font, and number of masks. At 4 deg eccentricity, the threshold contrast for identification of a 0.32 deg signal letter is elevated (up to six-fold) by mask letters anywhere in a 2.3 deg region, 7 times wider than the signal. In ordinary masking, threshold contrast rises as a power function of mask contrast, with a shallow log-log slope of 0.5 to 1, whereas, in crowding, threshold is a sigmoidal function of mask contrast, with a steep log-log slope of 2 at close spacing. Most remarkably, although the threshold elevation decreases exponentially with spacing, the threshold and saturation contrasts of crowding are independent of spacing. Finally, ordinary masking is similar for detection and identification, but crowding occurs only for identification, not detection. More precisely, crowding occurs only in tasks that cannot be done based on a single detection by coarsely coded feature detectors. These results (and observers' introspections) suggest that ordinary masking blocks feature detection, so the signal disappears, while crowding (like "illusory conjunction") is excessive feature integration - detected features are integrated over an inappropriately large area because there are no smaller integration fields - so the integrated signal is ambiguous, jumbled with the mask. In illusory conjunction, observers see an object that is not there made up of features that are. A survey of the illusory conjunction literature finds that most of the illusory conjunction results are consistent with the spatial crowding described here, which depends on spatial proximity, independent of time pressure. The rest seem to arise through a distinct phenomenon that one might call "temporal crowding," which depends on time pressure ("overloading attention"), independent of spatial proximity.     

Cue combination in a combined feature contrast detection and figure identification task

Target figures defined by feature contrast in spatial frequency, orientation or both cues had to be detected in Gabor random fields and their shape had to be identified in a dual task paradigm. Performance improved with increasing feature contrast and was strongly correlated among both tasks. Subjects performed significantly better with combined cues than with single cues. The improvement due to cue summation was stronger than predicted by the assumption of independent feature specific mechanisms, and increased with the performance level achieved with single cues until it was limited by ceiling effects. Further, cue summation was also strongly correlated among tasks: when there was benefit due to the additional cue in feature contrast detection, there was also benefit in figure identification. For the same performance level achieved with single cues, cue summation was generally larger in figure identification than in feature contrast detection, indicating more benefit when processes of shape and surface formation are involved. Our results suggest that cue combination improves spatial form completion and figure-ground segregation in noisy environments, and therefore leads to more stable object vision.     

Development of sensitivity to visual texture modulation in macaque monkeys

In human and non-human primates, higher form vision matures substantially later than spatial acuity and contrast sensitivity, as revealed by performance on such tasks as figure-ground segregation and contour integration. Our goal was to understand whether delayed maturation on these tasks was intrinsically form-dependent or, rather, related to the nature of spatial integration necessary for extracting task-relevant cues. We used an intermediate-level form task that did not call for extensive spatial integration. We trained monkeys (6-201 weeks) to discriminate the orientation of pattern modulation in a two-alternative forced choice paradigm. We presented two families of form patterns, defined by texture or contrast variations, and luminance-defined patterns for comparison. Infant monkeys could discriminate texture- and contrast-defined form as early as 6 weeks; sensitivity improved up to 40 weeks. Surprisingly, sensitivity for texture- and contrast-defined form matured earlier than for luminance-defined form. These results suggest that intermediate-level form vision develops in concert with basic spatial vision rather than following sequentially. Comparison with earlier results reveals that different aspects of form vision develop over different time courses, with processes that depend on comparing local image content maturing earlier than those requiring "global" linking of multiple visual elements across a larger spatial extent.     

Feature synergy depends on feature contrast and objecthood

Pairs of texture figures, defined by contrast in spatial frequency, orientation or both cues (redundant texture definition) had to be detected within a homogeneous Gabor field. In line with expectation we find better detection performance for arrangements with higher feature contrast along the border where the figures abut. Redundantly defined figures show synergy, a significant performance increase compared to the prediction of independent processing of orientation and spatial frequency cues. As found in previous studies [Spatial Vision 16 (2003) 459; Vision Research (submitted for publication)] this performance advantage is negatively correlated with visibility. In particular, figures with high border feature contrast are easily detectable but show weak synergy whereas figures with low border feature contrast are barely detectable but remarkably benefit from redundant texture definition. Closer analysis reveals that the form of the figures is also crucial: As long as they maintain a clear two dimensional shape the synergy effect is only marginally affected by variation figure size and border length. But when they degrade to one dimensional Gabor element arrays, synergy almost completely vanishes. The results imply that both factors, low visibility and objecthood, are critical for feature synergy. We conclude that facilitation across feature domains serves to segregate figure from ground when the signal from a single domain is too weak to enable object detection and vanishes under conditions of stable object vision.     

Multiple spatial frequency channels in human visual perceptual memory

Current models of short-term visual perceptual memory invoke mechanisms that are closely allied to low-level perceptual discrimination mechanisms. The purpose of this study was to investigate the extent to which human visual perceptual memory for spatial frequency is based upon multiple, spatially tuned channels similar to those found in the earliest stages of visual processing. To this end we measured how performance on a delayed spatial frequency discrimination paradigm was affected by the introduction of interfering or ‘memory masking’ stimuli of variable spatial frequency during the delay period. Masking stimuli were shown to induce shifts in the points of subjective equality (PSE) when their spatial frequencies were within a bandwidth of 1.2 octaves of the reference spatial frequency. When mask spatial frequencies differed by more than this value, there was no change in the PSE from baseline levels. This selective pattern of masking was observed for different spatial frequencies and demonstrates the existence of multiple, spatially tuned mechanisms in visual perceptual memory. Memory masking effects were also found to occur for horizontal separations of up to 6 deg between the masking and test stimuli and lacked any orientation selectivity. These findings add further support to the view that low-level sensory processing mechanisms form the basis for the retention of spatial frequency information in perceptual memory. However, the broad range of transfer of memory masking effects across spatial location and other dimensions indicates more long range, long duration interactions between spatial frequency channels that are likely to rely contributions from neural processes located in higher visual areas.     

Texture segregation and orientation gradient.

Rapid texture segregation is examined using filtered noise textures. The stimuli consist of a foreground region of filtered noise with one dominant texture orientation against a background region with a different dominant orientation. Shape discrimination of the foreground region is measured as a function of the difference in orientation between the two regions (delta theta), the distance over which the dominant orientation rotates from the background to the foreground value (delta chi), and the dominant spatial frequency of the textures (f). Performance declines with smaller delta theta, larger delta chi, and lower f. These effects are partially independent of viewing distance, which implies that it is the relative or object spatial frequency, not retinal spatial frequency, which determines performance in this task. We present a model consisting of channels tuned for orientation and spatial frequency which compute local oriented energy, followed by (texture) edge detection and a cross-correlator which performs the shape discrimination. Monte Carlo simulations of this model are in accord with the degradation in performance with increased delta chi and decreased delta theta.     

Response modulation by texture surround in primate area V1: correlates of "popout" under anesthesia

We studied the effects of contextual modulation in area V1 of anesthetized macaque monkeys. In 146 cells, responses to a single line over the center of the receptive field were compared with those to full texture patterns in which the center line was surrounded by similar lines at either the same orientation (uniform texture) or the orthogonal orientation (orientation contrast). On average, the responses to single lines were reduced by 42% when texture was presented in the surround. Uniform textures often produced stronger suppression (7% more, on average) so that lines with orientation contrast on average evoked larger responses than lines in uniform texture fields. This difference is correlated with perceptual differences between such stimuli, suggesting that physiological mechanisms contributing to the saliency ("popout") of textural stimuli operate, at least to some degree, even under anesthesia. Significant response modulation by the texture surround was seen in 112 cells (77%). Fifty-three cells (36%) responded differently to the two texture patterns; response preferences for orientation contrast (35 cells; 24%) were seen more often than preferences for uniform textures (18 cells; 12%). The remaining 59 cells (40%) were similarly suppressed by both texture surrounds. Detailed analysis of texture modulation revealed two major components of surround effects: (1) fast nonspecific ("general") suppression that occurred at about the same latency as excitatory responses and was found in all layers of striate cortex; and (2) differential response modulation that began about 60-70 ms after stimulus onset (about 15-20 ms after the onset of the excitatory response) and was less homogeneously distributed over cortical layers.     

Multiple spatial frequency channels in human visual perceptual memory

Current models of short-term visual perceptual memory invoke mechanisms that are closely allied to low-level perceptual discrimination mechanisms. The purpose of this study was to investigate the extent to which human visual perceptual memory for spatial frequency is based upon multiple, spatially tuned channels similar to those found in the earliest stages of visual processing. To this end we measured how performance on a delayed spatial frequency discrimination paradigm was affected by the introduction of interfering or 'memory masking' stimuli of variable spatial frequency during the delay period. Masking stimuli were shown to induce shifts in the points of subjective equality (PSE) when their spatial frequencies were within a bandwidth of 1.2 octaves of the reference spatial frequency. When mask spatial frequencies differed by more than this value, there was no change in the PSE from baseline levels. This selective pattern of masking was observed for different spatial frequencies and demonstrates the existence of multiple, spatially tuned mechanisms in visual perceptual memory. Memory masking effects were also found to occur for horizontal separations of up to 6 deg between the masking and test stimuli and lacked any orientation selectivity. These findings add further support to the view that low-level sensory processing mechanisms form the basis for the retention of spatial frequency information in perceptual memory. However, the broad range of transfer of memory masking effects across spatial location and other dimensions indicates more long range, long duration interactions between spatial frequency channels that are likely to rely contributions from neural processes located in higher visual areas.