Surface properties and the perception of color

We examined whether perception of color saturation and lightness depends on the three-dimensional (3D) shape and surface gloss of surfaces rendered to have different hues. In Experiment 1, we parametrically varied specular roughness of predominantly planar surfaces with different mesoscopic relief heights. The orientation of surfaces was varied relative to the light source and observer. Observers matched perceived lightness and chroma (effectively saturation) using spherical objects rendered using CIE LCH color space. We observed strong interactions between perceived saturation and lightness with changes in surface orientation and surface properties (specular roughness and 3D relief height). Declines in saturation and increases in lightness were observed with increasing specular roughness. Changes in relief height had greater effects on perceived saturation and lightness for blue hues compared with reddish and greenish hues. Experiment 2 found inverse correlations between perceived gloss and specular roughness across conditions. Experiment 3 estimated perceived specular coverage and found that a weighted combination of perceived gloss and specular coverage could account for perceived color saturation and lightness, with different coefficients accounting for the perceptual experience for each of the three hue conditions. These findings suggest that perceived color saturation and lightness depend on the separation of specular highlights from diffuse shading informative of chromatic surface reflectance.     

The effect of target salience and size in visual search within naturalistic scenes under degraded vision

We address two questions concerning eye guidance during visual search in naturalistic scenes. First, search has been described as a task in which visual salience is unimportant. Here, we revisit this question by using a letter-in-scene search task that minimizes any confounding effects that may arise from scene guidance. Second, we investigate how important the different regions of the visual field are for different subprocesses of search (target localization, verification). In Experiment 1, we manipulated both the salience (low vs. high) and the size (small vs. large) of the target letter (a “T”), and we implemented a foveal scotoma (radius: 1°) in half of the trials. In Experiment 2, observers searched for high- and low-salience targets either with full vision or with a central or peripheral scotoma (radius: 2.5°). In both experiments, we found main effects of salience with better performance for high-salience targets. In Experiment 1, search was faster for large than for small targets, and high-salience helped more for small targets. When searching with a foveal scotoma, performance was relatively unimpaired regardless of the target''s salience and size. In Experiment 2, both visual-field manipulations led to search time costs, but the peripheral scotoma was much more detrimental than the central scotoma. Peripheral vision proved to be important for target localization, and central vision for target verification. Salience affected eye movement guidance to the target in both central and peripheral vision. Collectively, the results lend support for search models that incorporate salience for predicting eye-movement behavior.     

Saccadic adaptation in the presence of artificial central scotomas

Saccadic adaptation can occur over a short period of time through a constant adjustment of the saccade target during the saccade, resulting in saccadic re-referencing, which directs the saccade to a location different from the target that elicited the saccade. Saccade re-referencing could be used to help patients with age-related macular degeneration to optimally use their residual visual function. However, it remains unknown whether saccade adaptation can take place in the presence of central scotomas (i.e., without central vision). We tested participants in two experiments in a conventional double-step paradigm with a central gaze-contingent artificial scotoma. Experiment 1 (N = 12) comprised a backward adaptation paradigm with no scotoma control, visible, and invisible 3° diameter scotoma conditions. Experiment 2 (N = 13) comprised a forward adaptation paradigm with no scotoma control, invisible 2°, and 4° diameter scotoma conditions. In Experiment 1, we observed significant adaptation in both the visible and invisible scotoma conditions comparable to the control condition with no scotoma. This was the case even when the saccade landed such that the target was occluded by the scotoma. We observed that adaptation occurred based on peripheral viewing of the stepped target during the deceleration period. In Experiment 2, we found that both scotoma conditions showed adaptation again comparable to the control condition with no scotoma. We conclude that saccadic adaptation can occur with central scotomas, showing that it does not require central vision and can be driven primarily by peripheral retinal error.     

Category systems for real-world scenes

Categorization performance is a popular metric of scene recognition and understanding in behavioral and computational research. However, categorical constructs and their labels can be somewhat arbitrary. Derived from exhaustive vocabularies of place names (e.g., Deng et al., 2009), or the judgements of small groups of researchers (e.g., Fei-Fei, Iyer, Koch, & Perona, 2007), these categories may not correspond with human-preferred taxonomies. Here, we propose clustering by increasing the rand index via coordinate ascent (CIRCA): an unsupervised, data-driven clustering method for deriving ground-truth scene categories. In Experiment 1, human participants organized 80 stereoscopic images of outdoor scenes from the Southampton-York Natural Scenes (SYNS) dataset (Adams et al., 2016) into discrete categories. In separate tasks, images were grouped according to i) semantic content, ii) three-dimensional spatial structure, or iii) two-dimensional image appearance. Participants provided text labels for each group. Using the CIRCA method, we determined the most representative category structure and then derived category labels for each task/dimension. In Experiment 2, we found that these categories generalized well to a larger set of SYNS images, and new observers. In Experiment 3, we tested the relationship between our category systems and the spatial envelope model (Oliva & Torralba, 2001). Finally, in Experiment 4, we validated CIRCA on a larger, independent dataset of same-different category judgements. The derived category systems outperformed the SUN taxonomy (Xiao, Hays, Ehinger, Oliva, & Torralba, 2010) and an alternative clustering method (Greene, 2019). In summary, we believe this novel categorization method can be applied to a wide range of datasets to derive optimal categorical groupings and labels from psychophysical judgements of stimulus similarity.     

The postdictive effect of choice reflects the modulation of attention on choice

Our conscious perception of the world is not an instantaneous, moment-by-moment construction. Rather, our perception of an event is influenced, over time, by information gained after the event; this is known as a postdictive effect. A recent study reported that this postdictive effect could occur even in choice. The present study sought to test whether the striking postdictive effect of choice reflects the modulation of attention on choice, by directly and systematically manipulating attention in two experiments. Specifically, Experiment 1 revealed that the robust postdictive effect of choice was almost completely eliminated when attentional bias was removed. More important, Experiment 2 demonstrated that the postdictive effect of choice could be modulated by directly manipulating participants’ attention with a spatial cue, in particular, when the cue appeared at short time delays. These results suggest that choice could be considerably postdictively influenced by attention and this effect was most pronounced within a short time window wherein decision making was most likely in progress. The current study not only enables clarification of the mechanism of the newly discovered postdictive effect of choice, but also extends evidence of the modulation of attention on decision making.     

Real-world objects are not stored in holistic representations in visual working memory

When storing multiple objects in visual working memory, observers sometimes misattribute perceived features to incorrect locations or objects. These misattributions are called binding errors (or swaps) and have been previously demonstrated mostly in simple objects whose features are easy to encode independently and arbitrarily chosen, like colors and orientations. Here, we tested whether similar swaps can occur with real-world objects, where the connection between features is meaningful rather than arbitrary. In Experiments 1 and 2, observers were simultaneously shown four items from two object categories. Within a category, the two exemplars could be presented in either the same or different states (e.g., open/closed; full/empty). After a delay, both exemplars from one of the categories were probed, and participants had to recognize which exemplar went with which state. We found good memory for state information and exemplar information on their own, but a significant memory decrement for exemplar–state combinations, suggesting that binding was difficult for observers and swap errors occurred even for meaningful real-world objects. In Experiment 3, we used the same task, but in one-half of the trials, the locations of the exemplars were swapped at test. We found that there are more errors in general when the locations of exemplars were swapped. We concluded that the internal features of real-world objects are not perfectly bound in working memory, and location updates impair object and feature representations. Overall, we provide evidence that even real-world objects are not stored in an entirely unitized format in working memory.     

Distinct processes of lighting priors for lightness and 3-D shape perception

The visual system often relies on prior assumptions when interpreting ambiguous visual inputs. A well-known example is the light-from-above prior, which aids the judgment of an object''s three-dimensional (3-D) shape (i.e., convex or concave). Recent studies have revealed that the light-from-above prior also helps solve lightness ambiguity. This study aimed to examine whether 3-D shape perception and lightness perception share the same lighting prior. The study participants performed two tasks: one focusing on lightness perception and another focusing on 3-D shape perception. The dominant directions of the assumed lighting were calculated from participants’ performance in the two tasks. The results showed that the assumed lighting direction for 3-D shape perception were considerably biased toward the left, whereas the one for lightness perception was almost from directly above. The clear difference between these two directions supports the hypothesis that the visual system uses distinct lighting priors for 3-D shape perception and lightness perception. Experiments 1 and 2 involved Japanese speaking participants and European participants, respectively. The Japanese language can be read and written both horizontally (i.e., left to right) and vertically (i.e., up to down) with lines progressing from right to left. Nevertheless, the two experiments still produced the same result, which suggests that the present finding is universal regardless of reading/writing direction.     

The effect of apparent distance on peripheral target detection

Previous research suggests that peripheral target detection is modulated by viewing distance and distance simulated by pictorial cues and optic flow. In the latter case, it is unclear what cues contribute to the effect of distance. The current study evaluated the effect of distance on peripheral detection in a virtual three-dimensional environment. Experiments 1–3 used a continuous, dynamic central task that simulated observers traveling either actively or passively through a virtual environment following a car. Peripheral targets were flashed on checkerboard-covered walls to the left and right of the path of motion, at a near and a far distance from the observer. The retinal characteristics of the targets were identical across distances. Experiment 1 found more accurate and faster detection for near targets compared to far targets, especially for larger eccentricities. Experiment 2 equated the predictability of target onset across distances and found the near advantage for larger eccentricities in accuracy but a much smaller effect in reaction time (RT). Experiment 3 removed the checkerboard background implemented in Experiments 1 and 2, and Experiment 4 manipulated several static, monocular cues. Experiments 3 and 4 found that the variation in the density of the checkerboard backgrounds could explain the main effect of distance on accuracy but could not completely account for the interaction between target distance and eccentricity. These results suggest that attention is modulated by target distance, but the effect is small. Finally, there were consistent divided attention costs in the central car-following task but not the peripheral detection task.     

Increasing perceptual separateness affects working memory for depth – re-allocation of attention from boundaries to the fixated center

For decades, working memory (WM) has been a heated research topic in the field of cognitive psychology. However, most studies on WM presented visual stimuli on a two-dimensional plane, rarely involving depth perception. Several previous studies have investigated how depth information is stored in WM, and found that WM for depth is even more limited in capacity and the memory performance is poor compared to visual WM. In the present study, we used a change detection task to investigate whether dissociating memory items by different visual features, thereby to increase their perceptual separateness, can improve WM performance for depth. Memory items presented at various depth planes were bound with different colors (Experiments 1 and 3) or sizes (Experiment 2). The memory performance for depth locations of visual stimuli with homogeneous and heterogeneous appearances were tested and compared. The results showed a consistent pattern that although separating items with various feature values did not affect the overall memory performance, the manipulation significantly improved memory performance for the middle depth locations but impaired the performance for the boundary locations when observers fixated at the center of the whole depth volume. The memory benefits of feature separation can be attributed to enhanced individuation of memory items, therefore facilitating a more balanced allocation of attention and memory resources.     

Attentional capture in multiple object tracking

Attentional processes are generally assumed to be involved in multiple object tracking (MOT). The attentional capture paradigm is regularly used to study conditions of attentional control. It has up to now not been used to assess influences of sudden onset distractor stimuli in MOT. We investigated whether attentional capture does occur in MOT: Are onset distractors processed at all in dynamic attentional tasks? We found that sudden onset distractors were effective in lowering probe detection, thus demonstrating attentional capture. Tracking performance as dependent measure was not affected. The attentional capture effect persisted in conditions of higher tracking load (Experiment 2) and was dramatically increased in lower presentation frequency of the onset distractor (Experiment 3). Tracking performance was shown to suffer only when onset distractors were presented serially with very short time gaps in between, thus effectively disturbing re-engaging attention on the tracking set (Experiment 4). We discuss that rapid dis- and re-engagement of the attention process on target objects and an additional more basic process that continuously provides location information allow managing strong disruptions of attention during tracking.     

Close - but not distant - conditioned flanker emotion affects crowding

Crowding is affected by conditioned stimulus emotion. This effect is clearly observed for conditioned flankers, but only marginally pronounced for conditioned targets. Studies on the processing of emotional stimuli suggest that the magnitude of the emotional effect depends on the presentation depth in that effects of emotion increase with decreasing distance to the observer in depth. Based on respective findings, we investigate crowding with stimuli of conditioned negative and neutral emotion across real depth; that is, stimuli were either presented closer, at or farther away than the fixation depth. Conditioned emotion of flankers affected crowding when flankers were presented closer than or at fixation depth, which is also the distance the target was presented at. Farther away than the fixation depth, flanker emotion did not alter crowding (Experiment 1a). Conditioned target emotion, however, did only show weak effects on crowding; neither when flankers (Experiment 1b) nor when targets were varied in depth (Experiment 2) there was a clear effect of target emotion, replicating findings in two-dimensional settings. Taken together, the results suggest that flanker''s emotional associations can become important for crowding, although, it depends on the special processing characteristics of stimulus emotion in depth. The conditioned emotion of targets scarcely affected crowding.     

Subjective control of polystable illusory apparent motion: Is control possible when the stimulus affords countless motion possibilities?

We investigate whether a new polystable illusion, illusory apparent motion (IAM), is susceptible to subjective perceptual control as has been shown in other polystable stimuli (e.g., the Necker cube, apparent motion quartets). Previous research has demonstrated that, although IAM shares some properties in common with other polystable stimuli, it also has some unique ones that make it unclear whether it should have similar susceptibility to subjective control. For example, IAM can be perceived in a countless number of directions and motion patterns (e.g., up–down, left–left, contracting–expanding, shear, diagonal). To explore perceptual control of IAM, in experiment 1 (n = 99) we used a motion persistence paradigm where participants are primed with different motion patterns and are instructed to control (change or hold) the initial motion pattern and indicate when the motion pattern changes. Building on experiment 1, experiment 2 (n = 76) brings the method more in line with previous subjective control research, testing whether participants can control their perception of IAM in a context without priming and while dynamically reporting their percepts throughout the trial. Findings from the two experiments demonstrate that participants were able to control their perception of IAM across paradigms. We explore the implications of these findings, strategies reported, and open questions for future research.     

Multidimensional feature interactions in visual crowding: When configural cues eliminate the polarity advantage

Crowding occurs when surrounding objects (flankers) impair target perception. A key property of crowding is the weaker interference when target and flankers strongly differ on a given dimension. For instance, identification of a target letter is usually superior with flankers of opposite versus the same contrast polarity as the target (the “polarity advantage”). High performance when target-flanker similarity is low has been attributed to the ungrouping of target and flankers. Here, we show that configural cues can override the usual advantage of low target-flanker similarity, and strong target-flanker grouping can reduce – instead of exacerbate – crowding. In Experiment 1, observers were presented with line triplets in the periphery and reported the tilt (left or right) of the central line. Target and flankers had the same (uniform condition) or opposite contrast polarity (alternating condition). Flanker configurations were either upright (||), unidirectionally tilted (\\ or //), or bidirectionally tilted (\/ or /\). Upright flankers yielded stronger crowding than unidirectional flankers, and weaker crowding than bidirectional flankers. Importantly, our results revealed a clear interaction between contrast polarity and flanker configuration. Triplets with upright and bidirectional flankers, but not unidirectional flankers, showed the polarity advantage. In Experiments 2 and 3, we showed that emergent features and redundancy masking (i.e. the reduction of the number of perceived items in repeating configurations) made it easier to discriminate between uniform triplets when flanker tilts were unidirectional (but not when bidirectional). We propose that the spatial configurations of uniform triplets with unidirectional flankers provided sufficient task-relevant information to enable a similar performance as with alternating triplets: strong-target flanker grouping alleviated crowding. We suggest that features which modulate crowding strength can interact non-additively, limiting the validity of typical crowding rules to contexts where only single, independent dimensions determine the effects of target-flanker similarity.     

Gaze dynamics are sensitive to target orienting for working memory encoding in virtual reality

Numerous studies have demonstrated that visuospatial attention is a requirement for successful working memory encoding. It is unknown, however, whether this established relationship manifests in consistent gaze dynamics as people orient their visuospatial attention toward an encoding target when searching for information in naturalistic environments. To test this hypothesis, participants'' eye movements were recorded while they searched for and encoded objects in a virtual apartment (Experiment 1). We decomposed gaze into 61 features that capture gaze dynamics and a trained sliding window logistic regression model that has potential for use in real-time systems to predict when participants found target objects for working memory encoding. A model trained on group data successfully predicted when people oriented to a target for encoding for the trained task (Experiment 1) and for a novel task (Experiment 2), where a new set of participants found objects and encoded an associated nonword in a cluttered virtual kitchen. Six of these features were predictive of target orienting for encoding, even during the novel task, including decreased distances between subsequent fixation/saccade events, increased fixation probabilities, and slower saccade decelerations before encoding. This suggests that as people orient toward a target to encode new information at the end of search, they decrease task-irrelevant, exploratory sampling behaviors. This behavior was common across the two studies. Together, this research demonstrates how gaze dynamics can be used to capture target orienting for working memory encoding and has implications for real-world use in technology and special populations.     

Multisensory integration attenuates visually induced oculomotor inhibition of return

Inhibition of return (IOR) is a mechanism of the attention system involving bias toward novel stimuli and delayed generation of responses to targets at previously attended locations. According to the two-component theory, IOR consists of a perceptual component and an oculomotor component (oculomotor IOR [O-IOR]) depending on whether the eye movement system is activated. Previous studies have shown that multisensory integration weakens IOR when paying attention to both visual and auditory modalities. However, it remains unclear whether the O-IOR effect attenuated by multisensory integration also occurs when the oculomotor system is activated. Here, using two eye movement experiments, we investigated the effect of multisensory integration on O-IOR using the exogenous spatial cueing paradigm. In Experiment 1, we found a greater visual O-IOR effect compared with audiovisual and auditory O-IOR in divided modality attention. The relative multisensory response enhancement (rMRE) and violations of Miller''s bound showed a greater magnitude of multisensory integration in the cued location compared with the uncued location. In Experiment 2, the magnitude of the audiovisual O-IOR effect was significantly less than that of the visual O-IOR in single visual modality selective attention. Implications for the effect of multisensory integration on O-IOR were discussed under conditions of oculomotor system activation, shedding new light on the two-component theory of IOR.     

Perceptual influence of auditory pitch on motion speed

There is a cross-modal mapping between auditory pitch and many visual properties, but the relationship between auditory pitch and motion speed is unexplored. In this article, the ball and baffle are used as the research objects, and an object collision experiment is used to explore the perceptual influence of auditory pitch on motion speed. Since cross-modal mapping can influence perceptual experience, this article also explores the influence of auditory pitch on action measures. In Experiment 1, 12 participants attempted to release a baffle to block a falling ball on the basis of speed judgment, and after each trial, they were asked to rate the speed of the ball. The speed score and baffle release time were recorded and used for analysis of variance. Since making explicit judgments about speed can alter the processing of visual paths, another group of participants in Experiment 2 completed the experiment without making explicit judgments about speed. Our results show that there is a cross-modal mapping between auditory pitch and motion speed, and high or low tones cause perception shift to faster or slower speeds.     

Inhibition continues to guide search under concurrent visual working memory load

It is well known that attention can be automatically attracted to salient items. However, recent studies show that it is possible to avoid distraction by a salient item (with a known feature), leading to facilitated search. This article tests a proposed mechanism for distractor inhibition: that a mental representation of the distractor feature held in visual working memory (VWM) allows attention to be guided away from the distractor. We tested this explanation by examining color-based inhibition in visual search for a shape target with and without VWM load. In Experiment 1 the presence of a distractor facilitated visual search under low and high VWM loads, as reflected in faster response times when the distractor was present (compared to absent), and in fewer eye movements to the salient distractor than the non-target items. However, the eye movement inhibition effect was noticeably weakened in the load conditions. Experiment 2 explored further, to distinguish between inhibition of the distractor color and activation of the (irrelevant) target color. Intermittently presenting single-color search trials that contained only either a target, distractor or a neutral-colored singleton revealed that the distractor color attracted attention less than the neutral color with and without VWM load. The target color, however, only attracted attention more than neutral colors under no load, whereas a VWM load completely eliminated this effect. This suggests that although VWM plays a role in guiding attention to the (irrelevant) target color, distractor-feature inhibition can operate independently.     

Diminishing sensitivity and absolute difference in value-driven attention

Kim and Beck (2020b) demonstrated that value-driven attention is based on relative value rather than absolute value, suggesting that prospect theory is relevant to our understanding of value-driven attention. To further this understanding, the present study investigated the impacts of diminishing sensitivity on value-driven attention. According to diminishing sensitivity, changes in outcomes have greater impacts nearer the reference point of 0 than farther from the point. Thus, the difference between $1 and $100 looms larger than that between $901 and $1000, due to their different ratios (100/1 > 1000/901). However, according to the absolute difference hypothesis, the differences should have similar impacts due to the absolute differences being the same (100 – 1 = 1000 – 901). Experiment 1 investigated whether diminishing sensitivity operates in the modified value-driven attention paradigm while controlling the impact of absolute differences. In the training phase, 100-point and 1000-point color targets had references of 1-point and 901-point color targets, respectively. In the test phase, 100-point color distractors attracted attention more than 1000-point color distractors, supporting the diminishing sensitivity hypothesis. Experiment 2 examined the absolute difference hypothesis while controlling the impact of diminishing sensitivity. Contrary to the absolute difference hypothesis, the test phase showed that 1000-point color distractors (compared with 10-point colors for a 990 absolute difference in the training phase) failed to attract attention more than 100-point color distractors (compared with 1-point colors, for a 99 absolute difference). These results suggest that diminishing sensitivity rather than absolute difference influences value-driven attention, further supporting the relevance of prospect theory to value-driven attention.     

If painters give you lemons,squeeze the knowledge out of them. A study on the visual perception of the translucent and juicy appearance of citrus fruits in paintings

Citrus fruits are characterized by a juicy and translucent interior, important properties that drive material recognition and food acceptance. Yet, a thorough understanding of their visual perception is still missing. Using citrus fruits depicted in 17th-century paintings as stimuli, we ran three rating experiments. In Experiment 1, participants rated the perceived similarity in translucency or juiciness of the fruits. In Experiment 2, different groups of participants rated one image feature from a list obtained in a preliminary experiment. In Experiment 3, translucency and juiciness were rated. We constructed two-dimensional perceptual spaces for both material properties and fitted the ratings of the image features into the spaces to interpret them. “Highlights,” “peeled side,” “bumpiness,” and “color saturation” fit the juiciness space best and were high for the highly juicy stimuli. “Peeled side,” “intensity of light gradient,” “highlights,” and “color saturation” were the most salient features of the translucency space, being high for the highly translucent stimuli. The same image features were also indicated in a 17th-century painting manual for material depiction (Beurs, 1692; Beurs, in press). Altogether, we disclosed the expertise of painters with regard to material perception by identifying the image features that trigger a visual impression of juiciness and translucency in citrus fruits.     

Post-saccadic changes disrupt attended pre-saccadic object memory

Trans-saccadic memory consists of keeping track of objects’ locations and features across saccades; pre-saccadic information is remembered and compared with post-saccadic information. It has been shown to have limited resources and involve attention with respect to the selection of objects and features. In support, a previous study showed that recognition of distinct post-saccadic objects in the visual scene is impaired when pre-saccadic objects are relevant and thus already encoded in memory (Poth, Herwig, Schneider, 2015). Here, we investigated the inverse (i.e. how the memory of pre-saccadic objects is affected by abrupt but irrelevant changes in the post-saccadic visual scene). We also modulated the amount of attention to the relevant pre-saccadic object by having participants either make a saccade to it or elsewhere and observed that pre-saccadic attentional facilitation affected how much post-saccadic changes disrupted trans-saccadic memory of pre-saccadic objects.Participants identified a flashed symbol (d, b, p, or q, among distracters), at one of six placeholders (figures “8”) arranged in circle around fixation while planning a saccade to one of them. They reported the identity of the symbol after the saccade. We changed the post-saccadic scene in Experiment one by removing the entire scene, only the placeholder where the pre-saccadic symbol was presented, or all other placeholders except this one. We observed reduced identification performance when only the saccade-target placeholder disappeared after the saccade. In Experiment two, we changed one placeholder location (inward/outward shift or rotation re. saccade vector) after the saccade and observed that identification performance decreased with increased shift/rotation of the saccade-target placeholder. We conclude that pre-saccadic memory is disrupted by abrupt attention-capturing post-saccadic changes of visual scene, particularly when these changes involve the object prioritized by being the goal of a saccade. These findings support the notion that limited trans-saccadic memory resources are disrupted when object correspondence at saccadic goal is broken through removal or location change.