A multiscale spatial filtering account of the Wertheimer-Benary effect and the corrugated Mondrian

Blakeslee and McCourt [Blakeslee, B., & McCourt, M.E. (1997). Similar mechanisms underlie simultaneous brightness contrast and grating induction. Vision Research, 37, 2849-2869] demonstrated that a multiscale array of two-dimensional difference-of-Gaussian (DOG) filters provided a simple but powerful model for explaining a number of seemingly complex features of grating induction (GI), while simultaneously encompassing salient features of brightness induction in simultaneous brightness contrast (SBC), brightness assimilation and Hermann Grid stimuli. The DOG model (and isotropic contrast models in general) cannot, however, account for another important group of brightness effects including the White effect [White, M. (1997). A new effect of pattern on perceived lightness. Perception, 8, 413-416] and a variant of SBC [Todorovic, D. (1997). Lightness and junctions. Perception, 26, 379-395]. Blakeslee and McCourt [Blakeslee, B., McCourt, M.E. (1999). A multiscale spatial filtering account of the White effect, simultaneous brightness contrast and grating induction. Vision Research, 39, 4361-4377] developed a modified version of the model, an oriented (ODOG) model, which differed from the DOG model in that the filters were anisotropic and their outputs were pooled nonlinearly. Using this model, they were able to account for both groups of induction effects. The present paper examines two additional sets of brightness illusions that cannot be explained by isotropic contrast models. Psychophysical brightness matching is employed to quantitatively measure the size of the brightness effect for two Wertheimer-Benary stimuli [Benary, W. (1924). Beobachtungen zu einem experiment uber helligkeitskontrast. Psychologische Forschung, 5, 131-142; Todorovic, D. (1997). Lightness and junctions. Perception, 26, 379-395] and for low- and high-contrast versions of corrugated Mondrian stimuli [Adelson, E.H. (1993). Perceptual organization and the jugdement of brightness. Science, 262, 2042-2044; Todorovic, D. (1997). Lightness and junctions. Perception, 26, 379-395]. Brightness matches are obtained on both homogeneous and checkerboard matching backgrounds. The ODOG model qualitatively predicts the appearance of the test patches in the Wertheimer-Benary stimuli and corrugated Mondrian stimuli. In addition, it quantitatively predicts the relative magnitudes of the corrugated Mondrian effects in the various conditions. In general, the psychophysical results and ODOG modeling argue strongly that like SBC, GI, the White effect and Todorovic's SBC demonstration, induced brightness in Wertheimer-Benary stimuli and in the corrugated Mondrian primarily reflects early-stage filtering operations in the visual system.     

Spatiotemporal analysis of brightness induction

Brightness induction refers to a class of visual illusions in which the perceived intensity of a region of space is influenced by the luminance of surrounding regions. These illusions are significant because they provide insight into the neural organization of the visual system. A novel quadrature-phase motion cancelation technique was developed to measure the magnitude of the grating induction brightness illusion across a wide range of spatial frequencies, temporal frequencies and test field heights. Canceling contrast is greatest at low frequencies and declines with increasing frequency in both dimensions, and with increasing test field height. Canceling contrast scales as the product of inducing grating spatial frequency and test field height (the number of inducing grating cycles per test field height). When plotted using a spatial axis which indexes this product, the spatiotemporal induction surfaces for four test field heights can be described as four partially overlapping sections of a single larger surface. These properties of brightness induction are explained in the context of multiscale spatial filtering. The present study is the first to measure the magnitude of grating induction as a function of temporal frequency. Taken in conjunction with several other studies ( [Blakeslee and McCourt, 2008], [Magnussen and Glad, 1975] and [Robinson and de Sa, 2008]) the results of this study illustrate that at least one form of brightness induction is very much faster than that reported by DeValois, Webster, DeValois, and Lingelbach (1986) and Rossi and Paradiso (1996), and are inconsistent with the proposition that brightness induction results from a slow “filling in” process.     

A multiscale spatial filtering account of the White effect, simultaneous brightness contrast and grating induction

Blakeslee and McCourt ((1997) Vision Research, 37, 2849-2869) demonstrated that a multiscale array of two-dimensional difference-of-Gaussian (DOG) filters provided a simple but powerful model for explaining a number of seemingly complex features of grating induction (GI), while simultaneously encompassing salient features of brightness induction in simultaneous brightness contrast (SBC), brightness assimilation and Hermann Grid stimuli. The DOG model (and isotropic contrast models in general) cannot, however, account for another important group of brightness effects which includes the White effect (White (1979) Perception, 8, 413-416) and the demonstrations of Todorovic ((1997) Perception, 26, 379-395). This paper introduces an oriented DOG (ODOG) model which differs from the DOG model in that the filters are anisotropic and their outputs are pooled nonlinearly. The ODOG model qualitatively predicts the appearance of the test patches in the White effect, the Todorovic demonstration, GI and SBC, while quantitatively predicting the relative magnitudes of these brightness effects as measured psychophysically using brightness matching. The model also accounts for both the smooth transition in test patch brightness seen in the White effect (White & White (1985) Vision Research, 25, 1331-1335) when the relative phase of the test patch is varied relative to the inducing grating, and for the spatial variation of brightness across the test patch as measured using point-by-point brightness matching. Finally, the model predicts intensive aspects of brightness induction measured in a series of Todorovic stimuli as the arms of the test crosses are lengthened (Pessoa, Baratoff, Neumann & Todorokov (1998) Investigative Ophthalmology and Visual Science, Supplement, 39, S159), but fails in one condition. Although it is concluded that higher-level perceptual grouping factors may play a role in determining brightness in this instance, in general the psychophysical results and ODOG modeling argue strongly that the induced brightness phenomena of SBC, GI, the White effect and the Todorovic demonstration, primarily reflect early-stage cortical filtering operations in the visual system.     

The local border mechanism in grating induction.

Both White's effect and the grating induction effect are examples of brightness contrast phenomena. Models to account for these effects have either explicitly rejected local border mechanisms (such as retinal ganglion cells) in favour of cortical mechanisms, or explicitly rejected elongated cortical filters in favour of local mechanisms. We have argued that any viable model must include both classes of mechanism. In this paper we present some novel versions of induction effects, and describe the explanatory power of a model couched solely in terms of the operation of local spatial filters. The model employs filters at different spatial scales whose outputs are then averaged. Using this approach it is possible to give a good account not only for the novel demonstrations we present, but also for the pattern of results reported by others concerning various manipulations of the spatial parameters of induction displays.     

Apparent contrast of a sinusoidal grating in the simultaneous presence of peripheral gratings

Apparent contrast of a vertical sinusoidal grating in the simultaneous presence of peripheral gratings was measured as a function of peripheral contrast, with test contrast, and relative phase and position of the two gratings as parameters. When the peripheral gratings were horizontally adjacent to the test grating, irrespective of the phase relation, the apparent contrast was raised in the range of peripheral contrast below the test contrast, but depressed in the range of peripheral contrast above the test contrast. When the peripheral gratings were vertically adjacent to the test grating, a similar tendency as mentioned above was observed under the in-phase condition. Under the opposite-phase condition, the apparent contrast was raised monotonically with an increase in peripheral contrast. These effects can be explained in terms of three processes of brightness induction, spatial summation and interaction between the spatial-frequency selective mechanisms.     

A unified theory of brightness contrast and assimilation incorporating oriented multiscale spatial filtering and contrast normalization

Brightness induction includes both contrast and assimilations effects. Brightness contrast occurs when the brightness of a test region shifts away from the brightness of adjacent regions. Brightness assimilation refers to the opposite situation in which the brightness of the test region shifts toward that of the surrounding regions. Interestingly, in the White effect [Perception 8 (1979) 413] the direction of the induced brightness change does not correlate with the amount of black or white border in contact with the gray test patch. This has led some investigators to reject spatial filtering explanations not only for the White effect but for brightness perception in general. Instead, these investigators have offered explanations based on a variety of junction analyses and/or perceptual organization schemes. Here, these approaches are challenged with a critical set of new psychophysical measurements that determined the magnitude of the White effect, the shifted White effect [Perception 10 (1981) 215] and the checkerboard illusion [R.L. DeValois, K.K. DeValois, Spatial Vision, Oxford University Press, NY, 1988] as a function of inducing pattern spatial frequency and test patch height. The oriented difference-of-Gaussians (ODOG) computational model of Blakeslee and McCourt [Vision Res. 39 (1999) 4361] parsimoniously accounts for the psychophysical data, and illustrates that mechanisms based on junction analysis or perceptual inference are not required to explain them. According to the ODOG model, brightness induction results from linear spatial filtering with an incomplete basis set (the finite array of spatial filters in the human visual system). In addition, orientation selectivity of the filters and contrast normalization across orientation channels are critical for explaining some brightness effects, such as the White effect.     

Brightness induction by local contrast and the spatial dependence of assimilation

Two mechanisms of brightness perception (1) brightness induction by local contrast and (2) assimilation, were examined for a variety of visual stimuli. Local contrast is the primary determinant of brightness perception, making objects appear brighter on a background of lower luminance and darker on a background of greater luminance. Assimilation is the opposite effect, whereby objects on a brighter (but not necessarily more luminant) background appear brighter or on a dark background appear darker. We have compared the relative strength of the two effects using stimuli which permit them to be studied separately. Brightness induction by local contrast is quantitatively stronger in all situations. Further, the strength of assimilation is strongly dependent on spatial parameters in the visual scene. These results are shown to be true both for simple visual stimuli as well as for complicated Mondrian-like patterns. The Retinex theory of brightness perception predicts that the two effects are equal. Our results show a range of relative strengths (assimilation vs brightness induction due to contrast) from 0.59 to 0.63 at 5' down to 0.34 at 43'.     

Computational neurobiology of the flash-lag effect

In the flash-lag effect (FLE) a moving object is perceived ahead of a stationary stimulus flashed in spatial alignment. Several explanations have been proposed to account for the FLE and its dependence on a variety of psychophysical attributes. Here, we show that a simple feed-forward network reproduces the standard FLE and several related manifestations, such as its modulation by stimulus luminance, trajectory, priming, and spatial predictability. A minimal set of elements, based on plausible neuronal mechanisms, yields a unified account of these visual illusions and possibly other perceptual phenomena.     

A possible role and basis of visual pathway selection in brightness induction

It is a well-known fact that the perceived brightness of any surface depends on the brightness of the surfaces that surround it. This phenomenon is termed as brightness induction. Isotropic arrays of multi-scale DoG (Difference of Gaussians) as well as cortical Oriented DoG (ODOG) and extensions thereof, like the Frequency-specific Locally Normalized ODOG (FLODOG) functions have been employed towards prediction of the direction of brightness induction in many brightness perception effects. But the neural basis of such spatial filters is seldom obvious. For instance, the visual information from retinal ganglion cells to such spatial filters, which have been generally speculated to appear at the early stage of cortical processing, are fed by at least three parallel channels viz. Parvocellular (P), Magnocellular (M) and Koniocellular (K) in the subcortical pathway, but the role of such pathways in brightness induction is generally not implicit. In this work, three different spatial filters based on an extended classical receptive field (ECRF) model of retinal ganglion cells, have been approximately related to the spatial contrast sensitivity functions of these three parallel channels. Based on our analysis involving different brightness perception effects, we propose that the M channel, with maximum conduction velocity, may have a special role for an initial sensorial perception. As a result, brightness assimilation may be the consequence of vision at a glance through the M pathway; contrast effect may be the consequence of a subsequent vision with scrutiny through the P channel; and the K pathway response may represent an intermediate situation resulting in ambiguity in brightness perception. The present work attempts to correlate this phenomenon of pathway selection with the complementary nature of these channels in terms of spatial frequency as well as contrast.     

Surround modulation of perceived contrast and the role of brightness induction

We studied iso- and cross-orientation surround modulation of perceived contrast (contrast-contrast phenomenon) with a contrast-matching method. Our results indicate (1) iso-oriented surrounds at all contrasts suppress perceived contrast of the test pattern. Cross-orientation surrounds, however, tend to enhance the perceived contrast of the test, particularly for high-contrast test patterns. Iso-orientation modulation acts over larger distances than does cross-orientation modulation. Surround modulation of perceived contrast is not accompanied by a simultaneous change of discrimination threshold. (2) Iso-orientation surround suppression is phase insensitive when brightness induction due to local luminance contrast is eliminated by a small center-surround gap. (3) Perceived contrast is similarly affected when the surround spatial frequency is equal to or higher than the center spatial frequency, but lower spatial frequency surrounds markedly enhance perceived contrast as a result of brightness induction. These data indicate that the contrast-contrast phenomenon is often mixed with brightness induction when it is measured with sinusoidal grating stimuli, and we suggest that this may account for some of the individual differences. After excluding the role of brightness induction, surround modulation of perceived contrast appears to be a second-order process that is phase independent and not tuned or very broadly tuned to spatial frequency.     

Contrast sensitivity, spatial and temporal tuning of the larval zebrafish optokinetic response

PURPOSE: To characterize the quantitative properties of the optokinetic response (OKR) in zebrafish larvae as a tool to test visual performance in genetically modified larvae. METHODS: Horizontal OKR was triggered in 5-day-old zebrafish larvae by stimulation with projected computer-generated gratings of varying contrast, angular velocity, temporal and spatial frequency, and brightness. Eye movements were analyzed by a custom-made eye tracker based on image analysis. RESULTS: The gain of the OKR slow phase was dependent on angular velocity, spatial frequency, and contrast of a moving grating, but largely independent on brightness. Eye velocity was a logarithmically linear function of grating contrast with a slope of approximately 0.8 per log unit contrast. CONCLUSIONS: The OKR of the larval zebrafish is not scaled for stimulus contrast and spatial frequency. These properties make the OKR a valuable tool to quantify behavioral visual performance such as visual acuity, contrast sensitivity, and light adaptation. This behavioral paradigm will be useful for analyzing visual performance in mutant and gene-knockdown larval zebrafish.     

Brightness induction magnitude declines with increasing distance from the inducing field edge

Brightness induction refers to a class of visual illusions where the perceived intensity of a region of space is influenced by the luminance of surrounding regions. These illusions are significant because they provide insight into the neural organization and processing strategies employed by the visual system. The nature of these processing strategies, however, has long been debated. Here we investigate the spatial characteristics of grating induction as a function of the distance from the inducing field edge to evaluate the viability of various competing models. In particular multiscale spatial filtering models and homogeneous filling-in models make very different predictions in regard to the magnitude of induction as a function of this distance. Filling-in explanations predict that the brightness/lightness of the filled-in region will be homogeneous, whereas multiscale filtering predicts a fall-off in induction magnitude with distance from the inducing field edge. Induction magnitude was measured using a narrow probe version of the quadrature-phase motion-cancellation paradigm (Blakeslee & McCourt, 2011) and a point-by-point brightness matching paradigm (Blakeslee and McCourt, 1997, Blakeslee and McCourt, 1999, McCourt, 1994). Both techniques reveal a decrease in the magnitude of induction with increasing distance from the inducing edge. A homogeneous filling-in mechanism cannot explain the induced structure in the test fields of these stimuli. The results argue strongly against filling-in mechanisms as well as against any mechanism that posits that induction is homogeneous. The structure of the induction is, however, well accounted for by the multiscale filtering (ODOG) model of Blakeslee and McCourt (1999). These results support models of brightness/lightness, such as filtering models, which preserve these gradients of induction.     

Disappearance of grating induction at scotopic luminances

The dependence of grating induction magnitude on retinal illuminance was examined in two subjects. Grating induction magnitude, as determined using the cancellation technique of McCourt, declines monotonically with decreasing retinal illuminance, effectively disappearing at a value of 0.3-0.5 phot td. In a second experiment, sensitivity differences for test lights of 500 and 600 nm were measured as a function of background illuminance in order to gauge the luminance operating range for grating induction with respect to duplex photoreceptor function. Cancelling contrast (and hence grating induction magnitude) fell below detection threshold contrast at retinal illuminances coinciding with the transition from photopic to scotopic visual function. In a third experiment, spatial contrast sensitivity was measured using both spatially extended (10 degrees) and truncated (2 degrees) sinewave gratings at frequencies below 2 c/deg, at three values of retinal illuminance. Illuminance values corresponded to those where grating induction magnitude was, as determined from the first experiment, either maximal, intermediate or negligible. Similar to grating induction, the strength of lateral inhibition, as indexed by the slope of the low-frequency decline in contrast sensitivity, is progressively reduced with decreasing retinal illuminance, particularly for the 2 degree field. There was, however, using the same criteria, evidence of lateral inhibition at a value of retinal illuminance which did not support grating induction. The implications of these results are discussed with respect to classical brightness contrast phenomena, recent neuroanatomical and neurophysiological evidence of segregated parvo- and magnocellular mediated contrast processing systems, and with results from previous studies of the grating induction effect.     

Oriented multiscale spatial filtering and contrast normalization: a parsimonious model of brightness induction in a continuum of stimuli including White, Howe and simultaneous brightness contrast

The White effect [Perception 8 (1979) 413] cannot be simply explained as due to either brightness contrast or brightness assimilation because the direction of the induced brightness change does not correlate with the amount of black or white border in contact with the gray test patch. This has led some investigators to abandon spatial filtering explanations not only for the White effect but for brightness perception in general. Offered instead are explanations based on a variety of junction analyses and/or perceptual organization schemes which in the case of the White effect are usually based on T-junctions. Recently, Howe [Perception 30 (2001) 1023] challenged T-junction based explanations with a novel variation of White's effect in which the T-junctions were constant while the brightness effect was eliminated or reversed, and proposed an alternative explanation in terms of illusory contours. The present study argues that an analysis at the level of illusory contours is not necessary and that a much simpler spatial filtering based explanation is sufficient. Brightness induction was measured in a set of stimuli chosen to illustrate the relationship between the Howe stimulus [Perception 30 (2001) 1023], the White stimulus [Perception 8 (1979) 413] and the classical simultaneous brightness contrast (SBC) stimulus. The White stimulus and the SBC stimulus occupy opposite ends of a continuum of stimuli in which the Howe stimulus is the mid-point. The psychophysical measurements were compared with the predictions of the oriented difference-of-Gaussians (ODOG) computational model of Blakeslee and McCourt [Vision Research 39 (1999) 4361]. The ODOG model parsimoniously accounted for both the direction and relative magnitude of the brightness effects suggesting that more complex mechanisms are not required to explain them.     

Suprathreshold information transfer in the visual system: Brightness match profiles of high contrast gratings

During the last decade, threshold information transfer in the visual system has received a great deal of attention. On the other hand, only a few studies have investigated suprathreshold transfer and the conclusions from this research conflict. This study was performed to investigate the initial stages of suprathreshold transfer. The subjective appearance of grating stimuli, quantified utilizing a brightness matching technique, provided the basic data. The results of the study indicate that following optical degradation, luminance information undergoes a spatially invariant compression which is approximately logarithmic in nature. Moreover, simultaneous contrast induction appears to play a crucial role in the appearance of suprathreshold stimuli.     

Lateral interactions within color mechanisms in simultaneous induced contrast.

The perceived color of a region of visual space is a function not only of the spectral composition of the light incident from it, but also depends on the light incident from surrounding regions. The color contrast induced into a region is a result of lateral interactions between neural mechanisms. These interactions were studied by measuring the induced effect of circularly symmetric spatial sine-waves on a circular central test region. The phase of the surrounding sine-waves was changed uniformly in time, inducing a modulation in the appearance of the test. Observers adjusted the amplitude of real sinusoidal modulation in the test in order to null the induced modulation, and the nulling modulation was used as a measure of the induced effect. Spatial additivity was tested by using pairs of sine-waves of distinct spatial frequencies. The results showed that brightness induction can be characterized as a linear spatial process, i.e. the effects of parts of the surround at different distances from the test are summed, after the effect of each part is weighted by a negative exponential as a function of distance from the test. The magnitude of pure chromatic induction, however, is a result of nonlinear spatial interactions. Thus, these results have implications for the connections between visual mechanisms that process brightness and chromatic contrast.     

Toward a unified chromatic induction model

In a previous work (X. Otazu, M. Vanrell, & C. A. Párraga, 2008b), we showed how several brightness induction effects can be predicted using a simple multiresolution wavelet model (BIWaM). Here we present a new model for chromatic induction processes (termed Chromatic Induction Wavelet Model or CIWaM), which is also implemented on a multiresolution framework and based on similar assumptions related to the spatial frequency and the contrast surround energy of the stimulus. The CIWaM can be interpreted as a very simple extension of the BIWaM to the chromatic channels, which in our case are defined in the MacLeod-Boynton (lsY) color space. This new model allows us to unify both chromatic assimilation and chromatic contrast effects in a single mathematical formulation. The predictions of the CIWaM were tested by means of several color and brightness induction experiments, which showed an acceptable agreement between model predictions and psychophysical data.     

Low-level features determine brightness in White’s and Benary’s illusions

We masked White’s and Benary’s brightness illusions and simultaneous contrast with narrowband visual noise and measured detection thresholds and brightness. The noise was either isotropic or orientation filtered. A narrow spatial frequency tuning was found for detection and brightness for every stimulus. A narrow orientation tuning was also found: the strength of the illusions decreased (White and Benary) or increased (White) depending on the orientation of the mask. The critical borders were always of the same contrast polarity. The results suggest that the brightness in figure-ground scenes is determined by mechanisms integrating incremental and decremental borders in early visual cortices.     

Contrast is enhanced by yellow lenses because of selective reduction of short-wavelength light.

PURPOSE: Although many studies have shown a subjective preference for yellow lenses, there has been little success in determining the clinical nature of this benefit. METHOD: Contrast sensitivity, color vision, accommodative-convergence, and visual acuity were measured in a group of 20 young subjects along with subjective rating of their perception through clear control lenses (380-nm cut-off), yellow lenses (450-nm cut-off), dark yellow lenses (511-nm cut-off), and orange lenses (527-nm cut-off). RESULTS: A systematic detriment to color vision was found to occur with increasing cut-off wavelength of the yellow lenses (p < 0.001) and this was significantly correlated to subjective ratings of color (r = -0.66) and brightness (r = -0.34). Perceived brightness significantly improved for the yellow (450-nm cut-off) lens only (p < 0.001). Although tinted lenses reduced contrast sensitivity to a white on black grating, there was a significant improvement in low to midrange spatial frequencies when measured using a white-on-blue grating. CONCLUSIONS: The detriment in color vision caused by yellow-colored lenses enhances contrast when viewing bright objects against a blue-based background, such as the sky. Contrast of overlying objects is enhanced is due to the selective reduction of short-wavelength light by the yellow lenses.